Nov 09 00:33:40 user nova-compute[74441]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74441) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 00:33:40 user nova-compute[74441]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74441) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 00:33:40 user nova-compute[74441]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74441) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 00:33:40 user nova-compute[74441]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:33:41 user nova-compute[74441]: INFO nova.virt.driver [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 09 00:33:41 user nova-compute[74441]: INFO nova.compute.provider_config [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Acquiring lock "singleton_lock" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Acquired lock "singleton_lock" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Releasing lock "singleton_lock" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Full set of CONF: {{(pid=74441) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ******************************************************************************** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Configuration options gathered from: {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ================================================================================ {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] allow_resize_to_same_host      = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] arq_binding_timeout            = 300 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] backdoor_port                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] backdoor_socket                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] block_device_allocate_retries  = 300 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] block_device_allocate_retries_interval = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cert                           = self.pem {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute_monitors               = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] config_dir                     = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] config_drive_format            = iso9660 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] config_source                  = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] console_host                   = user {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] control_exchange               = nova {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cpu_allocation_ratio           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] daemon                         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] debug                          = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] default_access_ip_network_name = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] default_availability_zone      = nova {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] default_ephemeral_format       = ext4 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] default_green_pool_size        = 1000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] default_schedule_zone          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] disk_allocation_ratio          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] enable_new_services            = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] enabled_ssl_apis               = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] flat_injected                  = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] force_config_drive             = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] force_raw_images               = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] graceful_shutdown_timeout      = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] heal_instance_info_cache_interval = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] host                           = user {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_build_timeout         = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_delete_interval       = 300 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_name_template         = instance-%08x {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_usage_audit           = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_usage_audit_period    = month {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] internal_service_availability_zone = internal {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] key                            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] live_migration_retry_count     = 30 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_config_append              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_dir                        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_file                       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_options                    = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_rotate_interval            = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_rotate_interval_type       = days {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] log_rotation_type              = none {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] long_rpc_timeout               = 1800 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] max_concurrent_builds          = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] max_concurrent_live_migrations = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] max_concurrent_snapshots       = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] max_local_block_devices        = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] max_logfile_count              = 30 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] max_logfile_size_mb            = 200 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] maximum_instance_delete_attempts = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metadata_listen                = 0.0.0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metadata_listen_port           = 8775 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metadata_workers               = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] migrate_max_retries            = -1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] mkisofs_cmd                    = genisoimage {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] my_ip                          = 10.0.0.210 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] network_allocate_retries       = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] osapi_compute_listen_port      = 8774 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] osapi_compute_unique_server_name_scope =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] osapi_compute_workers          = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] password_length                = 12 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] periodic_enable                = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] periodic_fuzzy_delay           = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] pointer_model                  = ps2mouse {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] preallocate_images             = none {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] publish_errors                 = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] pybasedir                      = /opt/stack/nova {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ram_allocation_ratio           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rate_limit_burst               = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rate_limit_except_level        = CRITICAL {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rate_limit_interval            = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reboot_timeout                 = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reclaim_instance_interval      = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] record                         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reimage_timeout_per_gb         = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] report_interval                = 120 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rescue_timeout                 = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reserved_host_cpus             = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reserved_host_disk_mb          = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reserved_host_memory_mb        = 512 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] reserved_huge_pages            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] resize_confirm_window          = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] resize_fs_using_block_device   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] resume_guests_state_on_host_boot = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rpc_response_timeout           = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] run_external_periodic_tasks    = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] running_deleted_instance_action = reap {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] running_deleted_instance_timeout = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler_instance_sync_interval = 120 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_down_time              = 720 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] servicegroup_driver            = db {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] shelved_offload_time           = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] shelved_poll_interval          = 3600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] shutdown_timeout               = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] source_is_ipv6                 = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ssl_only                       = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] state_path                     = /opt/stack/data/nova {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] sync_power_state_interval      = 600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] sync_power_state_pool_size     = 1000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] syslog_log_facility            = LOG_USER {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] tempdir                        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] timeout_nbd                    = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] transport_url                  = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] update_resources_interval      = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_cow_images                 = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_eventlog                   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_journal                    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_json                       = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_rootwrap_daemon            = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_stderr                     = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] use_syslog                     = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vcpu_pin_set                   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plugging_is_fatal          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plugging_timeout           = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] virt_mkfs                      = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] volume_usage_poll_interval     = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] watch_log_file                 = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] web                            = /usr/share/spice-html5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.auth_strategy              = keystone {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.compute_link_prefix        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.dhcp_domain                = novalocal {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.enable_instance_password   = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.glance_link_prefix         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.instance_list_per_project_cells = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.list_records_by_skipping_down_cells = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.local_metadata_per_cell    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.max_limit                  = 1000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.metadata_cache_expiration  = 15 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.neutron_default_tenant_id  = default {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.use_forwarded_for          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.use_neutron_default_nets   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_dynamic_targets = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_jsonfile_path   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.backend_argument         = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.config_prefix            = cache.oslo {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.dead_timeout             = 60.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.debug_cache_backend      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.enable_retry_client      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.enable_socket_keepalive  = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.enabled                  = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.expiration_time          = 600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_dead_retry      = 300 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_password        =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_sasl_enabled    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.memcache_username        =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.proxies                  = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.retry_attempts           = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.retry_delay              = 0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.socket_keepalive_count   = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.socket_keepalive_idle    = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.socket_keepalive_interval = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.tls_allowed_ciphers      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.tls_cafile               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.tls_certfile             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.tls_enabled              = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cache.tls_keyfile              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.auth_section            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.auth_type               = password {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.cafile                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.certfile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.collect_timing          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.cross_az_attach         = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.debug                   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.endpoint_template       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.http_retries            = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.insecure                = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.keyfile                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.os_region_name          = RegionOne {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.split_loggers           = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cinder.timeout                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.cpu_dedicated_set      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.cpu_shared_set         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.image_type_exclude_list = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.resource_provider_association_refresh = 300 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.shutdown_retry_interval = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] conductor.workers              = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] console.allowed_origins        = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] console.ssl_ciphers            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] console.ssl_minimum_version    = default {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] consoleauth.token_ttl          = 600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.cafile                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.certfile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.collect_timing          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.connect_retries         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.connect_retry_delay     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.endpoint_override       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.insecure                = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.keyfile                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.max_version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.min_version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.region_name             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.service_name            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.service_type            = accelerator {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.split_loggers           = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.status_code_retries     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.timeout                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] cyborg.version                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.backend               = sqlalchemy {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.connection            = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.connection_debug      = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.connection_parameters =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.connection_recycle_time = 3600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.connection_trace      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.db_inc_retry_interval = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.db_max_retries        = 20 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.db_max_retry_interval = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.db_retry_interval     = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.max_overflow          = 50 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.max_pool_size         = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.max_retries           = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.pool_timeout          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.retry_interval        = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.slave_connection      = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] database.sqlite_synchronous    = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.backend           = sqlalchemy {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.connection        = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.connection_debug  = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.connection_parameters =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.connection_recycle_time = 3600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.connection_trace  = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.db_inc_retry_interval = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.db_max_retries    = 20 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.db_max_retry_interval = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.db_retry_interval = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.max_overflow      = 50 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.max_pool_size     = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.max_retries       = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.pool_timeout      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.retry_interval    = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.slave_connection  = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] api_database.sqlite_synchronous = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] devices.enabled_mdev_types     = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ephemeral_storage_encryption.enabled = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.api_servers             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.cafile                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.certfile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.collect_timing          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.connect_retries         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.connect_retry_delay     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.debug                   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.default_trusted_certificate_ids = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.enable_certificate_validation = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.enable_rbd_download     = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.endpoint_override       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.insecure                = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.keyfile                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.max_version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.min_version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.num_retries             = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.rbd_ceph_conf           =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.rbd_connect_timeout     = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.rbd_pool                =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.rbd_user                =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.region_name             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.service_name            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.service_type            = image {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.split_loggers           = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.status_code_retries     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.timeout                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.verify_glance_signatures = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] glance.version                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] guestfs.debug                  = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.config_drive_cdrom      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.config_drive_inject_password = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.enable_remotefx         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.instances_path_share    =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.limit_cpu_features      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.use_multipath_io        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.vswitch_name            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] mks.enabled                    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] image_cache.manager_interval   = 2400 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] image_cache.precache_concurrency = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] image_cache.remove_unused_base_images = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] image_cache.subdirectory_name  = _base {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.api_max_retries         = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.api_retry_interval      = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.auth_section            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.auth_type               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.cafile                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.certfile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.collect_timing          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.conductor_group         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.connect_retries         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.connect_retry_delay     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.endpoint_override       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.insecure                = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.keyfile                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.max_version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.min_version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.peer_list               = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.region_name             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.serial_console_state_timeout = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.service_name            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.service_type            = baremetal {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.split_loggers           = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.status_code_retries     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.timeout                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ironic.version                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] key_manager.fixed_key          = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.barbican_api_version  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.barbican_endpoint     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.barbican_endpoint_type = public {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.barbican_region_name  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.cafile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.certfile              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.collect_timing        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.insecure              = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.keyfile               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.number_of_retries     = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.retry_delay           = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.send_service_user_token = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.split_loggers         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.timeout               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.verify_ssl            = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican.verify_ssl_path       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.auth_section = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.auth_type = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.cafile   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.certfile = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.collect_timing = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.insecure = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.keyfile  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.split_loggers = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] barbican_service_user.timeout  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.approle_role_id          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.approle_secret_id        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.cafile                   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.certfile                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.collect_timing           = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.insecure                 = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.keyfile                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.kv_mountpoint            = secret {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.kv_path                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.kv_version               = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.namespace                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.root_token_id            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.split_loggers            = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.ssl_ca_crt_file          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.timeout                  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.use_ssl                  = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.auth_section          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.auth_type             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.cafile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.certfile              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.collect_timing        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.connect_retries       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.connect_retry_delay   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.endpoint_override     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.insecure              = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.keyfile               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.max_version           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.min_version           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.region_name           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.service_name          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.service_type          = identity {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.split_loggers         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.status_code_retries   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.timeout               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] keystone.version               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.connection_uri         =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_mode               = custom {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: WARNING oslo_config.cfg [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_power_governor_high = performance {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_power_management   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.device_detach_attempts = 8 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.device_detach_timeout  = 20 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.disk_cachemodes        = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.disk_prefix            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.enabled_perf_events    = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.file_backed_memory     = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.gid_maps               = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.hw_disk_discard        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.hw_machine_type        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_rbd_pool        = rbd {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_type            = default {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.images_volume_group    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.inject_key             = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.inject_partition       = -2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.inject_password        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.iscsi_iface            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.iser_use_multipath     = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_downtime = 500 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_inbound_addr = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_scheme  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_timeout_action = abort {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_tunnelled = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: WARNING oslo_config.cfg [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 09 00:33:41 user nova-compute[74441]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 09 00:33:41 user nova-compute[74441]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 09 00:33:41 user nova-compute[74441]: and ``live_migration_inbound_addr`` respectively.
Nov 09 00:33:41 user nova-compute[74441]: ).  Its value may be silently ignored in the future.
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.live_migration_with_native_tls = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.max_queues             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.nfs_mount_options      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.num_pcie_ports         = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.pmem_namespaces        = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.quobyte_client_cfg     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rbd_secret_uuid        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rbd_user               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rescue_image_id        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rescue_kernel_id       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.rx_queue_size          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.smbfs_mount_options    =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.snapshot_compression   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.snapshot_image_format  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.sparse_logical_volumes = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.swtpm_enabled          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.swtpm_group            = tss {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.swtpm_user             = tss {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.sysinfo_serial         = unique {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.tb_cache_size          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.tx_queue_size          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.uid_maps               = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.use_virtio_for_bridges = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.virt_type              = kvm {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.volume_clear           = zero {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.volume_clear_size      = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.volume_use_multipath   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_cache_path   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.auth_section           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.auth_type              = password {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.cafile                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.certfile               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.collect_timing         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.connect_retries        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.connect_retry_delay    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.default_floating_pool  = public {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.endpoint_override      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.extension_sync_interval = 600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.http_retries           = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.insecure               = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.keyfile                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.max_version            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.min_version            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.ovs_bridge             = br-int {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.physnets               = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.region_name            = RegionOne {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.service_metadata_proxy = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.service_name           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.service_type           = network {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.split_loggers          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.status_code_retries    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.timeout                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] neutron.version                = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] notifications.bdms_in_notifications = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] notifications.default_level    = INFO {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] notifications.notification_format = unversioned {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] notifications.notify_on_state_change = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] pci.alias                      = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] pci.device_spec                = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] pci.report_in_placement        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.auth_section         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.auth_type            = password {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.cafile               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.certfile             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.collect_timing       = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.connect_retries      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.connect_retry_delay  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.default_domain_id    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.default_domain_name  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.domain_id            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.domain_name          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.endpoint_override    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.insecure             = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.keyfile              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.max_version          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.min_version          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.password             = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.project_domain_id    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.project_domain_name  = Default {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.project_id           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.project_name         = service {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.region_name          = RegionOne {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.service_name         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.service_type         = placement {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.split_loggers        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.status_code_retries  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.system_scope         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.timeout              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.trust_id             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.user_domain_id       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.user_domain_name     = Default {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.user_id              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.username             = placement {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] placement.version              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.cores                    = 20 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.count_usage_from_placement = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.injected_file_content_bytes = 10240 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.injected_file_path_length = 255 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.injected_files           = 5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.instances                = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.key_pairs                = 100 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.metadata_items           = 128 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.ram                      = 51200 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.recheck_quota            = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.server_group_members     = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] quota.server_groups            = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rdp.enabled                    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.image_metadata_prefilter = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.max_attempts         = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.max_placement_results = 1000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] scheduler.workers              = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.host_subset_size = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.isolated_hosts = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.isolated_images = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.pci_in_placement = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.track_instance_changes = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metrics.required               = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metrics.weight_multiplier      = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] metrics.weight_setting         = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] serial_console.enabled         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] serial_console.port_range      = 10000:20000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] serial_console.serialproxy_port = 6083 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.auth_section      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.auth_type         = password {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.cafile            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.certfile          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.collect_timing    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.insecure          = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.keyfile           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.send_service_user_token = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.split_loggers     = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] service_user.timeout           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.agent_enabled            = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.enabled                  = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.html5proxy_port          = 6082 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.image_compression        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.jpeg_compression         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.playback_compression     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.server_listen            = 127.0.0.1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.streaming_mode           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] spice.zlib_compression         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] upgrade_levels.baseapi         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] upgrade_levels.cert            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] upgrade_levels.compute         = auto {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] upgrade_levels.conductor       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] upgrade_levels.scheduler       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.cafile = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.certfile = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.insecure = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vendordata_dynamic_auth.timeout = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.api_retry_count         = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.ca_file                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.cache_prefix            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.cluster_name            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.connection_pool_size    = 10 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.console_delay_seconds   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.datastore_regex         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.host_ip                 = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.host_password           = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.host_port               = 443 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.host_username           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.insecure                = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.integration_bridge      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.maximum_objects         = 100 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.pbm_default_policy      = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.pbm_enabled             = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.pbm_wsdl_location       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.serial_port_proxy_uri   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.serial_port_service_uri = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.task_poll_interval      = 0.5 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.use_linked_clone        = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.vnc_keymap              = en-us {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.vnc_port                = 5900 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vmware.vnc_port_total          = 10000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.auth_schemes               = ['none'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.enabled                    = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.novncproxy_port            = 6080 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.vencrypt_ca_certs          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.vencrypt_client_cert       = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vnc.vencrypt_client_key        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.disable_rootwrap   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.enable_numa_live_migration = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.libvirt_disable_apic = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.client_socket_timeout     = 900 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.default_pool_size         = 1000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.keep_alive                = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.max_header_line           = 16384 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.ssl_ca_file               = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.ssl_cert_file             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.ssl_key_file              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.tcp_keepidle              = 600 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] zvm.ca_file                    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] zvm.cloud_connector_url        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] zvm.reachable_timeout          = 300 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.enforce_scope      = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.policy_default_rule = default {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.connection_string     = messaging:// {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.enabled               = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.es_doc_type           = notification {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.es_scroll_size        = 10000 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.es_scroll_time        = 2m {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.filter_error_trace    = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.hmac_keys             = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.sentinel_service_name = mymaster {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.socket_timeout        = 0.1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.trace_requests        = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler.trace_sqlalchemy      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler_jaeger.process_tags   = {} {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] profiler_otlp.service_name_prefix = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] remote_debug.host              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] remote_debug.port              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.auth_section        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.auth_type           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.cafile              = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.certfile            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.collect_timing      = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.connect_retries     = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.connect_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.endpoint_id         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.endpoint_override   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.insecure            = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.keyfile             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.max_version         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.min_version         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.region_name         = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.service_name        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.service_type        = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.split_loggers       = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.status_code_retries = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.status_code_retry_delay = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.timeout             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.valid_interfaces    = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_limit.version             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_reports.file_event_handler = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] oslo_reports.log_dir           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_ovs_privileged.group  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] vif_plug_ovs_privileged.user   = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.isolate_vif         = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] os_brick.lock_path             = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] privsep_osbrick.capabilities   = [21] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] privsep_osbrick.group          = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] privsep_osbrick.helper_command = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] privsep_osbrick.user           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] nova_sys_admin.group           = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] nova_sys_admin.helper_command  = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] nova_sys_admin.user            = None {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG oslo_service.service [None req-b6dafc86-d71a-4bd3-bd07-3985d2da95f4 None None] ******************************************************************************** {{(pid=74441) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 09 00:33:41 user nova-compute[74441]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Connecting to libvirt: qemu:///system {{(pid=74441) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0144d16fe0> {{(pid=74441) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 09 00:33:41 user nova-compute[74441]: libvirt:  error : internal error: could not initialize domain event timer
Nov 09 00:33:41 user nova-compute[74441]: WARNING nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0144d16fe0> {{(pid=74441) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Starting native event thread {{(pid=74441) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Starting green dispatch thread {{(pid=74441) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Starting connection event dispatch thread {{(pid=74441) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 09 00:33:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Connection event '1' reason 'None'
Nov 09 00:33:41 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 09 00:33:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.mount [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Initialising _HostMountState generation 0 {{(pid=74441) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 09 00:33:48 user nova-compute[74441]: INFO nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host capabilities <capabilities>
Nov 09 00:33:48 user nova-compute[74441]:   <host>
Nov 09 00:33:48 user nova-compute[74441]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 09 00:33:48 user nova-compute[74441]:     <cpu>
Nov 09 00:33:48 user nova-compute[74441]:       <arch>x86_64</arch>
Nov 09 00:33:48 user nova-compute[74441]:       <model>IvyBridge-IBRS</model>
Nov 09 00:33:48 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:48 user nova-compute[74441]:       <microcode version='1070'/>
Nov 09 00:33:48 user nova-compute[74441]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 09 00:33:48 user nova-compute[74441]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='ss'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='vmx'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='pcid'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='osxsave'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='hypervisor'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='arat'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='tsc_adjust'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='md-clear'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='stibp'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='arch-capabilities'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='ssbd'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='invtsc'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='rsba'/>
Nov 09 00:33:48 user nova-compute[74441]:       <feature name='skip-l1dfl-vmentry'/>
Nov 09 00:33:48 user nova-compute[74441]:       <pages unit='KiB' size='4'/>
Nov 09 00:33:48 user nova-compute[74441]:       <pages unit='KiB' size='2048'/>
Nov 09 00:33:48 user nova-compute[74441]:     </cpu>
Nov 09 00:33:48 user nova-compute[74441]:     <power_management>
Nov 09 00:33:48 user nova-compute[74441]:       <suspend_mem/>
Nov 09 00:33:48 user nova-compute[74441]:       <suspend_disk/>
Nov 09 00:33:48 user nova-compute[74441]:       <suspend_hybrid/>
Nov 09 00:33:48 user nova-compute[74441]:     </power_management>
Nov 09 00:33:48 user nova-compute[74441]:     <iommu support='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     <migration_features>
Nov 09 00:33:48 user nova-compute[74441]:       <live/>
Nov 09 00:33:48 user nova-compute[74441]:       <uri_transports>
Nov 09 00:33:48 user nova-compute[74441]:         <uri_transport>tcp</uri_transport>
Nov 09 00:33:48 user nova-compute[74441]:         <uri_transport>rdma</uri_transport>
Nov 09 00:33:48 user nova-compute[74441]:       </uri_transports>
Nov 09 00:33:48 user nova-compute[74441]:     </migration_features>
Nov 09 00:33:48 user nova-compute[74441]:     <topology>
Nov 09 00:33:48 user nova-compute[74441]:       <cells num='2'>
Nov 09 00:33:48 user nova-compute[74441]:         <cell id='0'>
Nov 09 00:33:48 user nova-compute[74441]:           <memory unit='KiB'>8140616</memory>
Nov 09 00:33:48 user nova-compute[74441]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 09 00:33:48 user nova-compute[74441]:           <pages unit='KiB' size='2048'>0</pages>
Nov 09 00:33:48 user nova-compute[74441]:           <distances>
Nov 09 00:33:48 user nova-compute[74441]:             <sibling id='0' value='10'/>
Nov 09 00:33:48 user nova-compute[74441]:             <sibling id='1' value='20'/>
Nov 09 00:33:48 user nova-compute[74441]:           </distances>
Nov 09 00:33:48 user nova-compute[74441]:           <cpus num='6'>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 09 00:33:48 user nova-compute[74441]:           </cpus>
Nov 09 00:33:48 user nova-compute[74441]:         </cell>
Nov 09 00:33:48 user nova-compute[74441]:         <cell id='1'>
Nov 09 00:33:48 user nova-compute[74441]:           <memory unit='KiB'>8255100</memory>
Nov 09 00:33:48 user nova-compute[74441]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 09 00:33:48 user nova-compute[74441]:           <pages unit='KiB' size='2048'>0</pages>
Nov 09 00:33:48 user nova-compute[74441]:           <distances>
Nov 09 00:33:48 user nova-compute[74441]:             <sibling id='0' value='20'/>
Nov 09 00:33:48 user nova-compute[74441]:             <sibling id='1' value='10'/>
Nov 09 00:33:48 user nova-compute[74441]:           </distances>
Nov 09 00:33:48 user nova-compute[74441]:           <cpus num='6'>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 09 00:33:48 user nova-compute[74441]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 09 00:33:48 user nova-compute[74441]:           </cpus>
Nov 09 00:33:48 user nova-compute[74441]:         </cell>
Nov 09 00:33:48 user nova-compute[74441]:       </cells>
Nov 09 00:33:48 user nova-compute[74441]:     </topology>
Nov 09 00:33:48 user nova-compute[74441]:     <cache>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 09 00:33:48 user nova-compute[74441]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 09 00:33:48 user nova-compute[74441]:     </cache>
Nov 09 00:33:48 user nova-compute[74441]:     <secmodel>
Nov 09 00:33:48 user nova-compute[74441]:       <model>apparmor</model>
Nov 09 00:33:48 user nova-compute[74441]:       <doi>0</doi>
Nov 09 00:33:48 user nova-compute[74441]:     </secmodel>
Nov 09 00:33:48 user nova-compute[74441]:     <secmodel>
Nov 09 00:33:48 user nova-compute[74441]:       <model>dac</model>
Nov 09 00:33:48 user nova-compute[74441]:       <doi>0</doi>
Nov 09 00:33:48 user nova-compute[74441]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 09 00:33:48 user nova-compute[74441]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 09 00:33:48 user nova-compute[74441]:     </secmodel>
Nov 09 00:33:48 user nova-compute[74441]:   </host>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='alpha'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>clipper</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='armv6l'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>spitz</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>nuri</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>kzm</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sx1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>z2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>tosa</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>n810</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>n800</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>terrier</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>midway</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>microbit</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>verdex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>highbank</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>akita</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>connex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>collie</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='armv7l'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>spitz</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>nuri</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>kzm</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sx1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>z2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>tosa</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>n810</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>n800</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>terrier</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>midway</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>microbit</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>verdex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>highbank</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>akita</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>connex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>collie</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='aarch64'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>spitz</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>nuri</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>kzm</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sx1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>z2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>tosa</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>n810</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>n800</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>terrier</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>midway</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>microbit</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>verdex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>raspi3b</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='4'>highbank</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>akita</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>connex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>collie</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <acpi default='on' toggle='yes'/>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='cris'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='i686'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>x-remote</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>isapc</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>microvm</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='kvm'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <pae/>
Nov 09 00:33:48 user nova-compute[74441]:       <nonpae/>
Nov 09 00:33:48 user nova-compute[74441]:       <acpi default='on' toggle='yes'/>
Nov 09 00:33:48 user nova-compute[74441]:       <apic default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='m68k'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>an5206</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>q800</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>next-cube</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='microblaze'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='microblazeel'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='mips'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='16'>malta</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='mipsel'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='16'>malta</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='mips64'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='16'>malta</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>pica61</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>magnum</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='mips64el'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='16'>malta</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>pica61</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>magnum</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='16'>boston</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='ppc'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>mac99</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>40p</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>taihu</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:48 user nova-compute[74441]:     </arch>
Nov 09 00:33:48 user nova-compute[74441]:     <features>
Nov 09 00:33:48 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:48 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:48 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:48 user nova-compute[74441]:     </features>
Nov 09 00:33:48 user nova-compute[74441]:   </guest>
Nov 09 00:33:48 user nova-compute[74441]:   <guest>
Nov 09 00:33:48 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:48 user nova-compute[74441]:     <arch name='ppc64'>
Nov 09 00:33:48 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:48 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2048'>powernv9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>taihu</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2048'>powernv10</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>40p</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 09 00:33:48 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>mac99</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2048'>powernv8</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='ppc64le'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2048'>powernv9</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>taihu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2048'>powernv10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>40p</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>mac99</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2048'>powernv8</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='riscv32'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='8'>spike</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>opentitan</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='5'>sifive_u</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>sifive_e</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='8'>virt</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='riscv64'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='8'>spike</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='5'>sifive_u</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>shakti_c</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>sifive_e</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='8'>virt</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='s390x'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='sh4'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>shix</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>r2d</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='sh4eb'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>shix</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>r2d</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='sparc'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>SS-5</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='4'>SS-20</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>LX</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>SS-4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='4'>SS-10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>Voyager</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='sparc64'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>sun4u</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>niagara</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>sun4v</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='x86_64'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>64</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>x-remote</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='1'>isapc</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>microvm</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='kvm'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <acpi default='on' toggle='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:       <apic default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='xtensa'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='4'>sim</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>kc705</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>ml605</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>virt</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx200</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx60</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]:   <guest>
Nov 09 00:33:49 user nova-compute[74441]:     <os_type>hvm</os_type>
Nov 09 00:33:49 user nova-compute[74441]:     <arch name='xtensaeb'>
Nov 09 00:33:49 user nova-compute[74441]:       <wordsize>32</wordsize>
Nov 09 00:33:49 user nova-compute[74441]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='4'>sim</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>kc705</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>ml605</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>virt</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx200</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>lx60</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 09 00:33:49 user nova-compute[74441]:       <domain type='qemu'/>
Nov 09 00:33:49 user nova-compute[74441]:     </arch>
Nov 09 00:33:49 user nova-compute[74441]:     <features>
Nov 09 00:33:49 user nova-compute[74441]:       <cpuselection/>
Nov 09 00:33:49 user nova-compute[74441]:       <deviceboot/>
Nov 09 00:33:49 user nova-compute[74441]:       <disksnapshot default='on' toggle='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     </features>
Nov 09 00:33:49 user nova-compute[74441]:   </guest>
Nov 09 00:33:49 user nova-compute[74441]: </capabilities>
Nov 09 00:33:49 user nova-compute[74441]: 
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-q35-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>i686</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='288'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'/>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='lm'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-i440fx-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>i686</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='255'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'/>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='lm'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ide</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-i440fx-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>i686</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='255'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'/>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='lm'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ide</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-q35-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>i686</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='288'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'/>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='lm'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-q35-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>x86_64</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='288'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>efi</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='invtsc'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='rsba'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-i440fx-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>x86_64</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='255'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>efi</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='invtsc'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='rsba'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ide</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-i440fx-6.2</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>x86_64</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='255'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>efi</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='invtsc'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='rsba'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ide</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 09 00:33:49 user nova-compute[74441]: <domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 00:33:49 user nova-compute[74441]:   <domain>kvm</domain>
Nov 09 00:33:49 user nova-compute[74441]:   <machine>pc-q35-jammy</machine>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>x86_64</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <vcpu max='288'/>
Nov 09 00:33:49 user nova-compute[74441]:   <iothreads supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:   <os supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='firmware'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>efi</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:     <loader supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>rom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pflash</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='readonly'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='secure'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>yes</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>no</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </loader>
Nov 09 00:33:49 user nova-compute[74441]:   </os>
Nov 09 00:33:49 user nova-compute[74441]:   <cpu>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-passthrough' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='hostPassthroughMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='maximum' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='maximumMigratable'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>on</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>off</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='host-model' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ss'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='vmx'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pcid'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='hypervisor'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arat'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='umip'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='md-clear'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='invtsc'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibpb'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='ibrs'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-stibp'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='rsba'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='erms'/>
Nov 09 00:33:49 user nova-compute[74441]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:     <mode name='custom' supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>qemu64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>qemu32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>phenom</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>pentium</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>n270</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm64</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>kvm32</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>coreduo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>core2duo</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>athlon</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Westmere</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Snowridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Skylake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>SandyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Penryn</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G5</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G4</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G3</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Opteron_G2</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Opteron_G1</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>IvyBridge</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Icelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Haswell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Rome</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-Milan</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>EPYC</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Dhyana</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cooperlake</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>Conroe</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='no'>Broadwell</model>
Nov 09 00:33:49 user nova-compute[74441]:       <model usable='yes'>486</model>
Nov 09 00:33:49 user nova-compute[74441]:     </mode>
Nov 09 00:33:49 user nova-compute[74441]:   </cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <memoryBacking supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:     <enum name='sourceType'>
Nov 09 00:33:49 user nova-compute[74441]:       <value>file</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>anonymous</value>
Nov 09 00:33:49 user nova-compute[74441]:       <value>memfd</value>
Nov 09 00:33:49 user nova-compute[74441]:     </enum>
Nov 09 00:33:49 user nova-compute[74441]:   </memoryBacking>
Nov 09 00:33:49 user nova-compute[74441]:   <devices>
Nov 09 00:33:49 user nova-compute[74441]:     <disk supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='diskDevice'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>disk</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cdrom</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>floppy</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>lun</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='bus'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>fdc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sata</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </disk>
Nov 09 00:33:49 user nova-compute[74441]:     <graphics supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='type'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>sdl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vnc</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>spice</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egl-headless</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </graphics>
Nov 09 00:33:49 user nova-compute[74441]:     <video supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='modelType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>cirrus</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>vmvga</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>qxl</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>none</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>bochs</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>ramfb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </video>
Nov 09 00:33:49 user nova-compute[74441]:     <hostdev supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='mode'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>subsystem</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='startupPolicy'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>default</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>mandatory</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>requisite</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>optional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='subsysType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>usb</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>pci</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>scsi</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='capsType'/>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='pciBackend'/>
Nov 09 00:33:49 user nova-compute[74441]:     </hostdev>
Nov 09 00:33:49 user nova-compute[74441]:     <rng supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtio-non-transitional</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>random</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>egd</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>builtin</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </rng>
Nov 09 00:33:49 user nova-compute[74441]:     <filesystem supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='driverType'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>path</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>handle</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>virtiofs</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </filesystem>
Nov 09 00:33:49 user nova-compute[74441]:     <tpm supported='yes'>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='model'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-tis</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>tpm-crb</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:       <enum name='backendModel'>
Nov 09 00:33:49 user nova-compute[74441]:         <value>passthrough</value>
Nov 09 00:33:49 user nova-compute[74441]:         <value>emulator</value>
Nov 09 00:33:49 user nova-compute[74441]:       </enum>
Nov 09 00:33:49 user nova-compute[74441]:     </tpm>
Nov 09 00:33:49 user nova-compute[74441]:   </devices>
Nov 09 00:33:49 user nova-compute[74441]:   <features>
Nov 09 00:33:49 user nova-compute[74441]:     <gic supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:     <vmcoreinfo supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <genid supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backingStoreInput supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <backup supported='yes'/>
Nov 09 00:33:49 user nova-compute[74441]:     <sev supported='no'/>
Nov 09 00:33:49 user nova-compute[74441]:   </features>
Nov 09 00:33:49 user nova-compute[74441]: </domainCapabilities>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74441) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74441) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Checking secure boot support for host arch (x86_64) {{(pid=74441) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Secure Boot support detected
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] cpu compare xml: <cpu match="exact">
Nov 09 00:33:49 user nova-compute[74441]:   <model>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]: </cpu>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.virt.node [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Generated node identity 72c49dde-a35c-4022-97fb-5b646dea5c73
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.virt.node [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Wrote node identity 72c49dde-a35c-4022-97fb-5b646dea5c73 to /opt/stack/data/nova/compute_id
Nov 09 00:33:49 user nova-compute[74441]: WARNING nova.compute.manager [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Compute nodes ['72c49dde-a35c-4022-97fb-5b646dea5c73'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.compute.manager [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 09 00:33:49 user nova-compute[74441]: WARNING nova.compute.manager [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 09 00:33:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:33:49 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:33:49 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Hypervisor/Node resource view: name=user free_ram=10963MB free_disk=26.052207946777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:33:49 user nova-compute[74441]: WARNING nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] No compute node record for user:72c49dde-a35c-4022-97fb-5b646dea5c73: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 72c49dde-a35c-4022-97fb-5b646dea5c73 could not be found.
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Compute node record created for user:user with uuid: 72c49dde-a35c-4022-97fb-5b646dea5c73
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] [req-6160b71f-5544-436f-8e71-71ff23ff93bb] Created resource provider record via placement API for resource provider with UUID 72c49dde-a35c-4022-97fb-5b646dea5c73 and name user.
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74441) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 09 00:33:49 user nova-compute[74441]: INFO nova.virt.libvirt.host [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] kernel doesn't support AMD SEV
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Libvirt baseline CPU <cpu>
Nov 09 00:33:49 user nova-compute[74441]:   <arch>x86_64</arch>
Nov 09 00:33:49 user nova-compute[74441]:   <model>Nehalem</model>
Nov 09 00:33:49 user nova-compute[74441]:   <vendor>Intel</vendor>
Nov 09 00:33:49 user nova-compute[74441]:   <topology sockets="6" cores="1" threads="1"/>
Nov 09 00:33:49 user nova-compute[74441]: </cpu>
Nov 09 00:33:49 user nova-compute[74441]:  {{(pid=74441) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Updated inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Updating resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 generation from 0 to 1 during operation: update_inventory {{(pid=74441) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 09 00:33:49 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:33:50 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Updating resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 generation from 1 to 2 during operation: update_traits {{(pid=74441) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 09 00:33:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:33:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:33:50 user nova-compute[74441]: DEBUG nova.service [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Creating RPC server for service compute {{(pid=74441) start /opt/stack/nova/nova/service.py:182}}
Nov 09 00:33:50 user nova-compute[74441]: DEBUG nova.service [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] Join ServiceGroup membership for this service compute {{(pid=74441) start /opt/stack/nova/nova/service.py:199}}
Nov 09 00:33:50 user nova-compute[74441]: DEBUG nova.servicegroup.drivers.db [None req-5af15ff1-96ad-41ea-9c54-4d70d36ac7bf None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74441) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 09 00:34:37 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:37 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:34:41 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:34:41 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=25.955970764160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:34:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:35:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:35:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:35:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:35:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=10303MB free_disk=26.008548736572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:35:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.095s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:36:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:36:44 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:36:44 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=10286MB free_disk=25.772747039794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:36:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:36:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:36:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:36:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:36:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:37:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:37:44 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:37:44 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=9591MB free_disk=25.791736602783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:37:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:37:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:37:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:37:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:37:49 user nova-compute[74441]: INFO nova.compute.claims [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Claim successful on node user
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:37:49 user nova-compute[74441]: DEBUG nova.network.neutron [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:37:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:37:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:37:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Creating image(s)
Nov 09 00:37:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "/opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "/opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "/opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:50 user nova-compute[74441]: DEBUG nova.policy [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73d2834f21dc4cc6840a537897051f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d039eb675084c51bafa66f59e350803', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG nova.virt.images [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] 8bb75127-e2cb-4fc7-b1f7-8e01f3707323 was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.part /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.part /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.converted" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.133s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:51 user nova-compute[74441]: INFO oslo.privsep.daemon [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpfr2mmjuw/privsep.sock']
Nov 09 00:37:51 user sudo[83700]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpfr2mmjuw/privsep.sock
Nov 09 00:37:51 user sudo[83700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:37:52 user nova-compute[74441]: INFO nova.compute.claims [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Claim successful on node user
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:37:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.policy [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8b687249f4d41d680915f2d30fc8dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51b840472c4aeb8a0a5f2a5dfad975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:37:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Creating image(s)
Nov 09 00:37:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Successfully created port: 482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:37:53 user sudo[83700]: pam_unix(sudo:session): session closed for user root
Nov 09 00:37:53 user nova-compute[74441]: INFO oslo.privsep.daemon [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Spawned new privsep daemon via rootwrap
Nov 09 00:37:53 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 00:37:53 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 00:37:53 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 09 00:37:53 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83710
Nov 09 00:37:53 user nova-compute[74441]: WARNING oslo_privsep.priv_context [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] privsep daemon already running
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.212s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.238s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk 1073741824" returned: 0 in 0.062s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.276s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.213s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk 1073741824" returned: 0 in 0.063s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Cannot resize image /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Ensure instance console log exists: /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.230s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Cannot resize image /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Ensure instance console log exists: /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.network.neutron [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Successfully updated port: 482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquired lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:37:54 user nova-compute[74441]: DEBUG nova.network.neutron [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-changed-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Refreshing instance network info cache due to event network-changed-482cee9a-dd80-4045-8899-c225ec471a01. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] Acquiring lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updating instance_info_cache with network_info: [{"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Releasing lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Instance network_info: |[{"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] Acquired lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.neutron [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Refreshing network info cache for port 482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Start _get_guest_xml network_info=[{"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:37:55 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:37:55 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1711349661',display_name='tempest-DeleteServersTestJSON-server-1711349661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1711349661',id=1,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d039eb675084c51bafa66f59e350803',ramdisk_id='',reservation_id='r-hpykz79o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1580679555',owner_user_name='tempest-DeleteServersTestJSON-1580679555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:37:50Z,user_data=None,user_id='73d2834f21dc4cc6840a537897051f26',uuid=84f7c9e9-5510-43ad-9b3e-b24e7a68e166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Converting VIF {"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lazy-loading 'pci_devices' on Instance uuid 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:37:55 user nova-compute[74441]:   <uuid>84f7c9e9-5510-43ad-9b3e-b24e7a68e166</uuid>
Nov 09 00:37:55 user nova-compute[74441]:   <name>instance-00000001</name>
Nov 09 00:37:55 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:37:55 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:37:55 user nova-compute[74441]:   <metadata>
Nov 09 00:37:55 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:37:55 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:37:55 user nova-compute[74441]:       <nova:name>tempest-DeleteServersTestJSON-server-1711349661</nova:name>
Nov 09 00:37:55 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:37:55</nova:creationTime>
Nov 09 00:37:55 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:37:55 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:37:55 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:37:55 user nova-compute[74441]:       <nova:owner>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:user uuid="73d2834f21dc4cc6840a537897051f26">tempest-DeleteServersTestJSON-1580679555-project-member</nova:user>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:project uuid="4d039eb675084c51bafa66f59e350803">tempest-DeleteServersTestJSON-1580679555</nova:project>
Nov 09 00:37:55 user nova-compute[74441]:       </nova:owner>
Nov 09 00:37:55 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:37:55 user nova-compute[74441]:       <nova:ports>
Nov 09 00:37:55 user nova-compute[74441]:         <nova:port uuid="482cee9a-dd80-4045-8899-c225ec471a01">
Nov 09 00:37:55 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 00:37:55 user nova-compute[74441]:         </nova:port>
Nov 09 00:37:55 user nova-compute[74441]:       </nova:ports>
Nov 09 00:37:55 user nova-compute[74441]:     </nova:instance>
Nov 09 00:37:55 user nova-compute[74441]:   </metadata>
Nov 09 00:37:55 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:37:55 user nova-compute[74441]:     <system>
Nov 09 00:37:55 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:37:55 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:37:55 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:37:55 user nova-compute[74441]:       <entry name="serial">84f7c9e9-5510-43ad-9b3e-b24e7a68e166</entry>
Nov 09 00:37:55 user nova-compute[74441]:       <entry name="uuid">84f7c9e9-5510-43ad-9b3e-b24e7a68e166</entry>
Nov 09 00:37:55 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:37:55 user nova-compute[74441]:     </system>
Nov 09 00:37:55 user nova-compute[74441]:   </sysinfo>
Nov 09 00:37:55 user nova-compute[74441]:   <os>
Nov 09 00:37:55 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:37:55 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:37:55 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:37:55 user nova-compute[74441]:   </os>
Nov 09 00:37:55 user nova-compute[74441]:   <features>
Nov 09 00:37:55 user nova-compute[74441]:     <acpi/>
Nov 09 00:37:55 user nova-compute[74441]:     <apic/>
Nov 09 00:37:55 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:37:55 user nova-compute[74441]:   </features>
Nov 09 00:37:55 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:37:55 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:37:55 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:37:55 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:37:55 user nova-compute[74441]:   </clock>
Nov 09 00:37:55 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:37:55 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:37:55 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:37:55 user nova-compute[74441]:   </cpu>
Nov 09 00:37:55 user nova-compute[74441]:   <devices>
Nov 09 00:37:55 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:37:55 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:37:55 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk"/>
Nov 09 00:37:55 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:37:55 user nova-compute[74441]:     </disk>
Nov 09 00:37:55 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:37:55 user nova-compute[74441]:       <mac address="fa:16:3e:25:8d:56"/>
Nov 09 00:37:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:37:55 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:37:55 user nova-compute[74441]:       <target dev="tap482cee9a-dd"/>
Nov 09 00:37:55 user nova-compute[74441]:     </interface>
Nov 09 00:37:55 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:37:55 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/console.log" append="off"/>
Nov 09 00:37:55 user nova-compute[74441]:     </serial>
Nov 09 00:37:55 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:37:55 user nova-compute[74441]:     <video>
Nov 09 00:37:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:37:55 user nova-compute[74441]:     </video>
Nov 09 00:37:55 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:37:55 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:37:55 user nova-compute[74441]:     </rng>
Nov 09 00:37:55 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:37:55 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:37:55 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:37:55 user nova-compute[74441]:     </memballoon>
Nov 09 00:37:55 user nova-compute[74441]:   </devices>
Nov 09 00:37:55 user nova-compute[74441]: </domain>
Nov 09 00:37:55 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1711349661',display_name='tempest-DeleteServersTestJSON-server-1711349661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1711349661',id=1,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d039eb675084c51bafa66f59e350803',ramdisk_id='',reservation_id='r-hpykz79o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1580679555',owner_user_name='tempest-DeleteServersTestJSON-1580679555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:37:50Z,user_data=None,user_id='73d2834f21dc4cc6840a537897051f26',uuid=84f7c9e9-5510-43ad-9b3e-b24e7a68e166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Converting VIF {"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG os_vif [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Created schema index Interface.name {{(pid=74441) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Created schema index Port.name {{(pid=74441) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Created schema index Bridge.name {{(pid=74441) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [POLLOUT] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Successfully created port: 958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7568303-0115-5136-8d17-478c9edde253', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:37:56 user nova-compute[74441]: INFO oslo.privsep.daemon [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkp4y3jbf/privsep.sock']
Nov 09 00:37:56 user sudo[83748]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkp4y3jbf/privsep.sock
Nov 09 00:37:56 user sudo[83748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 00:37:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:57 user nova-compute[74441]: DEBUG nova.network.neutron [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updated VIF entry in instance network info cache for port 482cee9a-dd80-4045-8899-c225ec471a01. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:37:57 user nova-compute[74441]: DEBUG nova.network.neutron [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updating instance_info_cache with network_info: [{"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:37:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-412dfd72-f003-46b5-bdec-192cd223c53d req-d5fa1ffd-e0d6-4ea0-b4eb-d83bd2cb1cd5 service nova] Releasing lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:37:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:58 user sudo[83748]: pam_unix(sudo:session): session closed for user root
Nov 09 00:37:58 user nova-compute[74441]: INFO oslo.privsep.daemon [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Spawned new privsep daemon via rootwrap
Nov 09 00:37:58 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 00:37:58 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 00:37:58 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 09 00:37:58 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83751
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap482cee9a-dd, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap482cee9a-dd, col_values=(('qos', UUID('a1e8aeb9-7ee0-4116-8815-c05db8cb9909')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap482cee9a-dd, col_values=(('external_ids', {'iface-id': '482cee9a-dd80-4045-8899-c225ec471a01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:8d:56', 'vm-uuid': '84f7c9e9-5510-43ad-9b3e-b24e7a68e166'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:58 user nova-compute[74441]: INFO os_vif [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd')
Nov 09 00:37:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:37:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] No VIF found with MAC fa:16:3e:25:8d:56, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Successfully updated port: 958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing instance network info cache due to event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:37:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance network_info: |[{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.network.neutron [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Start _get_guest_xml network_info=[{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:38:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-88303642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-88303642',id=2,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU2K0OW+0sJ+wwOPgYhH0cv/tCXPXCJeBIP8GE3Z/9n5f7E63IgDULTOQpNDGvh0Hj9/dhOwj0uaLKCYDS/6dUQgUBVusLFERHApraybJANbOANs/xDMdQKEcLYp0yCew==',key_name='tempest-keypair-555090617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-xa6rl5bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=d717ddbc-6c16-4b0b-812a-6cb46b5314dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.objects.instance [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'pci_devices' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:38:01 user nova-compute[74441]:   <uuid>d717ddbc-6c16-4b0b-812a-6cb46b5314dc</uuid>
Nov 09 00:38:01 user nova-compute[74441]:   <name>instance-00000002</name>
Nov 09 00:38:01 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:38:01 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:38:01 user nova-compute[74441]:   <metadata>
Nov 09 00:38:01 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:38:01 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:38:01 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-88303642</nova:name>
Nov 09 00:38:01 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:38:01</nova:creationTime>
Nov 09 00:38:01 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:38:01 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:38:01 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:38:01 user nova-compute[74441]:       <nova:owner>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:user uuid="e8b687249f4d41d680915f2d30fc8dbd">tempest-AttachVolumeShelveTestJSON-1580389683-project-member</nova:user>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:project uuid="6f51b840472c4aeb8a0a5f2a5dfad975">tempest-AttachVolumeShelveTestJSON-1580389683</nova:project>
Nov 09 00:38:01 user nova-compute[74441]:       </nova:owner>
Nov 09 00:38:01 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:38:01 user nova-compute[74441]:       <nova:ports>
Nov 09 00:38:01 user nova-compute[74441]:         <nova:port uuid="958e30c3-1bcc-4902-8868-851d7f71c00e">
Nov 09 00:38:01 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 00:38:01 user nova-compute[74441]:         </nova:port>
Nov 09 00:38:01 user nova-compute[74441]:       </nova:ports>
Nov 09 00:38:01 user nova-compute[74441]:     </nova:instance>
Nov 09 00:38:01 user nova-compute[74441]:   </metadata>
Nov 09 00:38:01 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:38:01 user nova-compute[74441]:     <system>
Nov 09 00:38:01 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:38:01 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:38:01 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:38:01 user nova-compute[74441]:       <entry name="serial">d717ddbc-6c16-4b0b-812a-6cb46b5314dc</entry>
Nov 09 00:38:01 user nova-compute[74441]:       <entry name="uuid">d717ddbc-6c16-4b0b-812a-6cb46b5314dc</entry>
Nov 09 00:38:01 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:38:01 user nova-compute[74441]:     </system>
Nov 09 00:38:01 user nova-compute[74441]:   </sysinfo>
Nov 09 00:38:01 user nova-compute[74441]:   <os>
Nov 09 00:38:01 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:38:01 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:38:01 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:38:01 user nova-compute[74441]:   </os>
Nov 09 00:38:01 user nova-compute[74441]:   <features>
Nov 09 00:38:01 user nova-compute[74441]:     <acpi/>
Nov 09 00:38:01 user nova-compute[74441]:     <apic/>
Nov 09 00:38:01 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:38:01 user nova-compute[74441]:   </features>
Nov 09 00:38:01 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:38:01 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:38:01 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:38:01 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:38:01 user nova-compute[74441]:   </clock>
Nov 09 00:38:01 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:38:01 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:38:01 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:38:01 user nova-compute[74441]:   </cpu>
Nov 09 00:38:01 user nova-compute[74441]:   <devices>
Nov 09 00:38:01 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:38:01 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:38:01 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk"/>
Nov 09 00:38:01 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:38:01 user nova-compute[74441]:     </disk>
Nov 09 00:38:01 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:38:01 user nova-compute[74441]:       <mac address="fa:16:3e:fd:53:97"/>
Nov 09 00:38:01 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:01 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:38:01 user nova-compute[74441]:       <target dev="tap958e30c3-1b"/>
Nov 09 00:38:01 user nova-compute[74441]:     </interface>
Nov 09 00:38:01 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:38:01 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/console.log" append="off"/>
Nov 09 00:38:01 user nova-compute[74441]:     </serial>
Nov 09 00:38:01 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:38:01 user nova-compute[74441]:     <video>
Nov 09 00:38:01 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:01 user nova-compute[74441]:     </video>
Nov 09 00:38:01 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:38:01 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:38:01 user nova-compute[74441]:     </rng>
Nov 09 00:38:01 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:38:01 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:38:01 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:38:01 user nova-compute[74441]:     </memballoon>
Nov 09 00:38:01 user nova-compute[74441]:   </devices>
Nov 09 00:38:01 user nova-compute[74441]: </domain>
Nov 09 00:38:01 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-88303642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-88303642',id=2,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU2K0OW+0sJ+wwOPgYhH0cv/tCXPXCJeBIP8GE3Z/9n5f7E63IgDULTOQpNDGvh0Hj9/dhOwj0uaLKCYDS/6dUQgUBVusLFERHApraybJANbOANs/xDMdQKEcLYp0yCew==',key_name='tempest-keypair-555090617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-xa6rl5bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=d717ddbc-6c16-4b0b-812a-6cb46b5314dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG os_vif [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65407fe9-95a2-5b22-b397-29fc18ef137f', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap958e30c3-1b, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap958e30c3-1b, col_values=(('qos', UUID('b86a7938-4966-4810-add9-0a6729453f25')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap958e30c3-1b, col_values=(('external_ids', {'iface-id': '958e30c3-1bcc-4902-8868-851d7f71c00e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:53:97', 'vm-uuid': 'd717ddbc-6c16-4b0b-812a-6cb46b5314dc'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:01 user nova-compute[74441]: INFO os_vif [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b')
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No VIF found with MAC fa:16:3e:fd:53:97, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Instance spawned successfully.
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:02 user nova-compute[74441]: INFO nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Took 12.25 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:02 user nova-compute[74441]: DEBUG nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:02 user nova-compute[74441]: INFO nova.compute.manager [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Took 13.55 seconds to build instance.
Nov 09 00:38:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-34a54a34-d035-4824-998c-540a059b9020 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.853s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:03 user nova-compute[74441]: DEBUG nova.network.neutron [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updated VIF entry in instance network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:38:03 user nova-compute[74441]: DEBUG nova.network.neutron [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-01261e92-aa32-4aa4-95c7-ac5a90e9acbd req-13a8c53c-6c0f-4820-90f2-569bbe6b8793 service nova] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance spawned successfully.
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:05 user nova-compute[74441]: INFO nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Took 13.02 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:05 user nova-compute[74441]: INFO nova.compute.manager [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Took 13.91 seconds to build instance.
Nov 09 00:38:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7ed06b58-1fdb-4a44-b212-775d5b5b62ca tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.072s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-fc8935e6-1cfa-45e3-87e5-d2b7c2c477bc req-db38ecfb-29c7-44e3-bc9c-eabcbf8cca85 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fc8935e6-1cfa-45e3-87e5-d2b7c2c477bc req-db38ecfb-29c7-44e3-bc9c-eabcbf8cca85 service nova] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fc8935e6-1cfa-45e3-87e5-d2b7c2c477bc req-db38ecfb-29c7-44e3-bc9c-eabcbf8cca85 service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fc8935e6-1cfa-45e3-87e5-d2b7c2c477bc req-db38ecfb-29c7-44e3-bc9c-eabcbf8cca85 service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-fc8935e6-1cfa-45e3-87e5-d2b7c2c477bc req-db38ecfb-29c7-44e3-bc9c-eabcbf8cca85 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] No waiting events found dispatching network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:10 user nova-compute[74441]: WARNING nova.compute.manager [req-fc8935e6-1cfa-45e3-87e5-d2b7c2c477bc req-db38ecfb-29c7-44e3-bc9c-eabcbf8cca85 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received unexpected event network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 for instance with vm_state active and task_state None.
Nov 09 00:38:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-60096e6f-d3f2-4fd7-a802-286ab864f5b6 req-59dcf320-2871-45a8-85e7-6b5a7058cdaf service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-60096e6f-d3f2-4fd7-a802-286ab864f5b6 req-59dcf320-2871-45a8-85e7-6b5a7058cdaf service nova] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-60096e6f-d3f2-4fd7-a802-286ab864f5b6 req-59dcf320-2871-45a8-85e7-6b5a7058cdaf service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-60096e6f-d3f2-4fd7-a802-286ab864f5b6 req-59dcf320-2871-45a8-85e7-6b5a7058cdaf service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-60096e6f-d3f2-4fd7-a802-286ab864f5b6 req-59dcf320-2871-45a8-85e7-6b5a7058cdaf service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] No waiting events found dispatching network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:12 user nova-compute[74441]: WARNING nova.compute.manager [req-60096e6f-d3f2-4fd7-a802-286ab864f5b6 req-59dcf320-2871-45a8-85e7-6b5a7058cdaf service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received unexpected event network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 for instance with vm_state active and task_state None.
Nov 09 00:38:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-1989d0b6-5f35-4b0f-9021-b76f28c6921a req-2caebf52-835d-4250-b9e0-7cdaa92b5c40 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1989d0b6-5f35-4b0f-9021-b76f28c6921a req-2caebf52-835d-4250-b9e0-7cdaa92b5c40 service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1989d0b6-5f35-4b0f-9021-b76f28c6921a req-2caebf52-835d-4250-b9e0-7cdaa92b5c40 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1989d0b6-5f35-4b0f-9021-b76f28c6921a req-2caebf52-835d-4250-b9e0-7cdaa92b5c40 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-1989d0b6-5f35-4b0f-9021-b76f28c6921a req-2caebf52-835d-4250-b9e0-7cdaa92b5c40 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:17 user nova-compute[74441]: WARNING nova.compute.manager [req-1989d0b6-5f35-4b0f-9021-b76f28c6921a req-2caebf52-835d-4250-b9e0-7cdaa92b5c40 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state active and task_state None.
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:38:17 user nova-compute[74441]: INFO nova.compute.claims [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Claim successful on node user
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:38:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 09 00:38:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:38:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Creating image(s)
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "/opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "/opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "/opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "fbc45390b1b102250da703e93a0341e739503f3a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "fbc45390b1b102250da703e93a0341e739503f3a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG nova.policy [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a995fb8a8049e881b6ca3818eca0eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d11ffa9f74456ea45d00a6b6f32260', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG nova.virt.images [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] 1a821288-e3cf-46a9-b5db-b9d7aa277f55 was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:38:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.part /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.part /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.converted" returned: 0 in 0.358s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-10e858a1-54c4-4a1c-871c-dffcbf98f84f req-b5f77d20-3b5e-45ae-9869-f9ed1c3bff0c service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-10e858a1-54c4-4a1c-871c-dffcbf98f84f req-b5f77d20-3b5e-45ae-9869-f9ed1c3bff0c service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-10e858a1-54c4-4a1c-871c-dffcbf98f84f req-b5f77d20-3b5e-45ae-9869-f9ed1c3bff0c service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-10e858a1-54c4-4a1c-871c-dffcbf98f84f req-b5f77d20-3b5e-45ae-9869-f9ed1c3bff0c service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-10e858a1-54c4-4a1c-871c-dffcbf98f84f req-b5f77d20-3b5e-45ae-9869-f9ed1c3bff0c service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:19 user nova-compute[74441]: WARNING nova.compute.manager [req-10e858a1-54c4-4a1c-871c-dffcbf98f84f req-b5f77d20-3b5e-45ae-9869-f9ed1c3bff0c service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state active and task_state None.
Nov 09 00:38:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Successfully created port: 3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "fbc45390b1b102250da703e93a0341e739503f3a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.458s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "fbc45390b1b102250da703e93a0341e739503f3a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "fbc45390b1b102250da703e93a0341e739503f3a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a,backing_fmt=raw /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a,backing_fmt=raw /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk 1073741824" returned: 0 in 0.058s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "fbc45390b1b102250da703e93a0341e739503f3a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:38:20 user nova-compute[74441]: INFO nova.compute.claims [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Claim successful on node user
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Successfully updated port: 3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquired lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-changed-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Refreshing instance network info cache due to event network-changed-3a0c3a06-c493-4f7a-8f30-961e9f20389c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] Acquiring lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Cannot resize image /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Ensure instance console log exists: /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:38:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.policy [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adf38aba1dcf4d8e8cb89728ff19509b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce510b60b4e444f930d32c5301698d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:38:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Creating image(s)
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updating instance_info_cache with network_info: [{"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.228s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Releasing lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Instance network_info: |[{"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] Acquired lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.network.neutron [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Refreshing network info cache for port 3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Start _get_guest_xml network_info=[{"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:38:08Z,direct_url=<?>,disk_format='qcow2',id=1a821288-e3cf-46a9-b5db-b9d7aa277f55,min_disk=0,min_ram=0,name='',owner='9a518b0f76cc47109abdf6c9b5d50dc7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:38:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '1a821288-e3cf-46a9-b5db-b9d7aa277f55'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:38:21 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:21 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:38:08Z,direct_url=<?>,disk_format='qcow2',id=1a821288-e3cf-46a9-b5db-b9d7aa277f55,min_disk=0,min_ram=0,name='',owner='9a518b0f76cc47109abdf6c9b5d50dc7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:38:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-993205133',display_name='tempest-AttachSCSIVolumeTestJSON-server-993205133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-993205133',id=3,image_ref='1a821288-e3cf-46a9-b5db-b9d7aa277f55',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGv/1T5kLyb3FkT6vsbkvYRp+BoU176fi8y0BhaQl5GN6e9WedPubA3+iURa1rUkOVq1gaAvbwBzfX4vtmkKSGm+UxWY1HC5IsWe905T0JYEoypHANkdRzuNYj3m1EnbA==',key_name='tempest-keypair-217887964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d11ffa9f74456ea45d00a6b6f32260',ramdisk_id='',reservation_id='r-x60e49vq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1a821288-e3cf-46a9-b5db-b9d7aa277f55',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1980231610',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1980231610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a995fb8a8049e881b6ca3818eca0eb',uuid=265471cf-50b2-4759-a485-fa5e2a4e50a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Converting VIF {"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lazy-loading 'pci_devices' on Instance uuid 265471cf-50b2-4759-a485-fa5e2a4e50a8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.233s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk 1073741824" returned: 0 in 0.096s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:38:21 user nova-compute[74441]:   <uuid>265471cf-50b2-4759-a485-fa5e2a4e50a8</uuid>
Nov 09 00:38:21 user nova-compute[74441]:   <name>instance-00000003</name>
Nov 09 00:38:21 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:38:21 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:38:21 user nova-compute[74441]:   <metadata>
Nov 09 00:38:21 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:38:21 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:38:21 user nova-compute[74441]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-993205133</nova:name>
Nov 09 00:38:21 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:38:21</nova:creationTime>
Nov 09 00:38:21 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:38:21 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:38:21 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:38:21 user nova-compute[74441]:       <nova:owner>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:user uuid="77a995fb8a8049e881b6ca3818eca0eb">tempest-AttachSCSIVolumeTestJSON-1980231610-project-member</nova:user>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:project uuid="13d11ffa9f74456ea45d00a6b6f32260">tempest-AttachSCSIVolumeTestJSON-1980231610</nova:project>
Nov 09 00:38:21 user nova-compute[74441]:       </nova:owner>
Nov 09 00:38:21 user nova-compute[74441]:       <nova:root type="image" uuid="1a821288-e3cf-46a9-b5db-b9d7aa277f55"/>
Nov 09 00:38:21 user nova-compute[74441]:       <nova:ports>
Nov 09 00:38:21 user nova-compute[74441]:         <nova:port uuid="3a0c3a06-c493-4f7a-8f30-961e9f20389c">
Nov 09 00:38:21 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 00:38:21 user nova-compute[74441]:         </nova:port>
Nov 09 00:38:21 user nova-compute[74441]:       </nova:ports>
Nov 09 00:38:21 user nova-compute[74441]:     </nova:instance>
Nov 09 00:38:21 user nova-compute[74441]:   </metadata>
Nov 09 00:38:21 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:38:21 user nova-compute[74441]:     <system>
Nov 09 00:38:21 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:38:21 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:38:21 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:38:21 user nova-compute[74441]:       <entry name="serial">265471cf-50b2-4759-a485-fa5e2a4e50a8</entry>
Nov 09 00:38:21 user nova-compute[74441]:       <entry name="uuid">265471cf-50b2-4759-a485-fa5e2a4e50a8</entry>
Nov 09 00:38:21 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:38:21 user nova-compute[74441]:     </system>
Nov 09 00:38:21 user nova-compute[74441]:   </sysinfo>
Nov 09 00:38:21 user nova-compute[74441]:   <os>
Nov 09 00:38:21 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:38:21 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:38:21 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:38:21 user nova-compute[74441]:   </os>
Nov 09 00:38:21 user nova-compute[74441]:   <features>
Nov 09 00:38:21 user nova-compute[74441]:     <acpi/>
Nov 09 00:38:21 user nova-compute[74441]:     <apic/>
Nov 09 00:38:21 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:38:21 user nova-compute[74441]:   </features>
Nov 09 00:38:21 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:38:21 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:38:21 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:38:21 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:38:21 user nova-compute[74441]:   </clock>
Nov 09 00:38:21 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:38:21 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:38:21 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:38:21 user nova-compute[74441]:   </cpu>
Nov 09 00:38:21 user nova-compute[74441]:   <devices>
Nov 09 00:38:21 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:38:21 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:38:21 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk"/>
Nov 09 00:38:21 user nova-compute[74441]:       <target dev="sda" bus="scsi"/>
Nov 09 00:38:21 user nova-compute[74441]:       <address type="drive" controller="0" unit="0"/>
Nov 09 00:38:21 user nova-compute[74441]:     </disk>
Nov 09 00:38:21 user nova-compute[74441]:     <disk type="file" device="cdrom">
Nov 09 00:38:21 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 00:38:21 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.config"/>
Nov 09 00:38:21 user nova-compute[74441]:       <target dev="sdb" bus="scsi"/>
Nov 09 00:38:21 user nova-compute[74441]:       <address type="drive" controller="0" unit="1"/>
Nov 09 00:38:21 user nova-compute[74441]:     </disk>
Nov 09 00:38:21 user nova-compute[74441]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 09 00:38:21 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:38:21 user nova-compute[74441]:       <mac address="fa:16:3e:00:b0:33"/>
Nov 09 00:38:21 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:21 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:38:21 user nova-compute[74441]:       <target dev="tap3a0c3a06-c4"/>
Nov 09 00:38:21 user nova-compute[74441]:     </interface>
Nov 09 00:38:21 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:38:21 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/console.log" append="off"/>
Nov 09 00:38:21 user nova-compute[74441]:     </serial>
Nov 09 00:38:21 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:38:21 user nova-compute[74441]:     <video>
Nov 09 00:38:21 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:21 user nova-compute[74441]:     </video>
Nov 09 00:38:21 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:38:21 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:38:21 user nova-compute[74441]:     </rng>
Nov 09 00:38:21 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:38:21 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:38:21 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:38:21 user nova-compute[74441]:     </memballoon>
Nov 09 00:38:21 user nova-compute[74441]:   </devices>
Nov 09 00:38:21 user nova-compute[74441]: </domain>
Nov 09 00:38:21 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-993205133',display_name='tempest-AttachSCSIVolumeTestJSON-server-993205133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-993205133',id=3,image_ref='1a821288-e3cf-46a9-b5db-b9d7aa277f55',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGv/1T5kLyb3FkT6vsbkvYRp+BoU176fi8y0BhaQl5GN6e9WedPubA3+iURa1rUkOVq1gaAvbwBzfX4vtmkKSGm+UxWY1HC5IsWe905T0JYEoypHANkdRzuNYj3m1EnbA==',key_name='tempest-keypair-217887964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13d11ffa9f74456ea45d00a6b6f32260',ramdisk_id='',reservation_id='r-x60e49vq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1a821288-e3cf-46a9-b5db-b9d7aa277f55',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1980231610',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1980231610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a995fb8a8049e881b6ca3818eca0eb',uuid=265471cf-50b2-4759-a485-fa5e2a4e50a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Converting VIF {"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG os_vif [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa5d0074-ed19-5573-856d-67ef3045169d', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a0c3a06-c4, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a0c3a06-c4, col_values=(('qos', UUID('25645d13-1ba1-4676-8686-0bb8f216c1a0')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a0c3a06-c4, col_values=(('external_ids', {'iface-id': '3a0c3a06-c493-4f7a-8f30-961e9f20389c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:b0:33', 'vm-uuid': '265471cf-50b2-4759-a485-fa5e2a4e50a8'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:21 user nova-compute[74441]: INFO os_vif [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4')
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.246s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] No BDM found with device name sda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] No VIF found with MAC fa:16:3e:00:b0:33, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:38:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Using config drive
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Cannot resize image /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Ensure instance console log exists: /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Successfully created port: 791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:38:22 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Creating config drive at /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.config
Nov 09 00:38:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsp8nd1ah {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updated VIF entry in instance network info cache for port 3a0c3a06-c493-4f7a-8f30-961e9f20389c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updating instance_info_cache with network_info: [{"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-530c20f2-4a74-44d9-9238-b6b25ba5716e req-4acc8d8a-8dc1-4f04-8755-abb3cd69c1fd service nova] Releasing lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsp8nd1ah" returned: 0 in 0.120s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.network.neutron [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Successfully updated port: 791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.network.neutron [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-changed-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Refreshing instance network info cache due to event network-changed-791979c2-d197-4cdf-9d7a-a0a895ce47c6. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:22 user nova-compute[74441]: DEBUG nova.network.neutron [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.neutron [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Instance network_info: |[{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Refreshing network info cache for port 791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Start _get_guest_xml network_info=[{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:38:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.objects.instance [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'pci_devices' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:38:23 user nova-compute[74441]:   <uuid>f4bd46e4-44cb-4b47-9781-4adece881c74</uuid>
Nov 09 00:38:23 user nova-compute[74441]:   <name>instance-00000004</name>
Nov 09 00:38:23 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:38:23 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:38:23 user nova-compute[74441]:   <metadata>
Nov 09 00:38:23 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:38:23 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:38:23 user nova-compute[74441]:       <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:38:23 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:38:23</nova:creationTime>
Nov 09 00:38:23 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:38:23 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:38:23 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:38:23 user nova-compute[74441]:       <nova:owner>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:38:23 user nova-compute[74441]:       </nova:owner>
Nov 09 00:38:23 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:38:23 user nova-compute[74441]:       <nova:ports>
Nov 09 00:38:23 user nova-compute[74441]:         <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:38:23 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:38:23 user nova-compute[74441]:         </nova:port>
Nov 09 00:38:23 user nova-compute[74441]:       </nova:ports>
Nov 09 00:38:23 user nova-compute[74441]:     </nova:instance>
Nov 09 00:38:23 user nova-compute[74441]:   </metadata>
Nov 09 00:38:23 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:38:23 user nova-compute[74441]:     <system>
Nov 09 00:38:23 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:38:23 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:38:23 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:38:23 user nova-compute[74441]:       <entry name="serial">f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:38:23 user nova-compute[74441]:       <entry name="uuid">f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:38:23 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:38:23 user nova-compute[74441]:     </system>
Nov 09 00:38:23 user nova-compute[74441]:   </sysinfo>
Nov 09 00:38:23 user nova-compute[74441]:   <os>
Nov 09 00:38:23 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:38:23 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:38:23 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:38:23 user nova-compute[74441]:   </os>
Nov 09 00:38:23 user nova-compute[74441]:   <features>
Nov 09 00:38:23 user nova-compute[74441]:     <acpi/>
Nov 09 00:38:23 user nova-compute[74441]:     <apic/>
Nov 09 00:38:23 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:38:23 user nova-compute[74441]:   </features>
Nov 09 00:38:23 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:38:23 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:38:23 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:38:23 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:38:23 user nova-compute[74441]:   </clock>
Nov 09 00:38:23 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:38:23 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:38:23 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:38:23 user nova-compute[74441]:   </cpu>
Nov 09 00:38:23 user nova-compute[74441]:   <devices>
Nov 09 00:38:23 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:38:23 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:38:23 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk"/>
Nov 09 00:38:23 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:38:23 user nova-compute[74441]:     </disk>
Nov 09 00:38:23 user nova-compute[74441]:     <disk type="file" device="cdrom">
Nov 09 00:38:23 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 00:38:23 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config"/>
Nov 09 00:38:23 user nova-compute[74441]:       <target dev="hda" bus="ide"/>
Nov 09 00:38:23 user nova-compute[74441]:     </disk>
Nov 09 00:38:23 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:38:23 user nova-compute[74441]:       <mac address="fa:16:3e:d3:4b:2d"/>
Nov 09 00:38:23 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:23 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:38:23 user nova-compute[74441]:       <target dev="tap791979c2-d1"/>
Nov 09 00:38:23 user nova-compute[74441]:     </interface>
Nov 09 00:38:23 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:38:23 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log" append="off"/>
Nov 09 00:38:23 user nova-compute[74441]:     </serial>
Nov 09 00:38:23 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:38:23 user nova-compute[74441]:     <video>
Nov 09 00:38:23 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:23 user nova-compute[74441]:     </video>
Nov 09 00:38:23 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:38:23 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:38:23 user nova-compute[74441]:     </rng>
Nov 09 00:38:23 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:38:23 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:38:23 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:38:23 user nova-compute[74441]:     </memballoon>
Nov 09 00:38:23 user nova-compute[74441]:   </devices>
Nov 09 00:38:23 user nova-compute[74441]: </domain>
Nov 09 00:38:23 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG os_vif [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b6120e6-09f6-5fd1-8c11-52a992174171', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap791979c2-d1, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap791979c2-d1, col_values=(('qos', UUID('9b0948bf-65ad-4da8-9dcb-1428c94f5d20')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap791979c2-d1, col_values=(('external_ids', {'iface-id': '791979c2-d197-4cdf-9d7a-a0a895ce47c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:4b:2d', 'vm-uuid': 'f4bd46e4-44cb-4b47-9781-4adece881c74'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: INFO os_vif [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1')
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No BDM found with device name hda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No VIF found with MAC fa:16:3e:d3:4b:2d, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:38:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Using config drive
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Creating config drive at /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config
Nov 09 00:38:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdhryrz17 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updated VIF entry in instance network info cache for port 791979c2-d197-4cdf-9d7a-a0a895ce47c6. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdhryrz17" returned: 0 in 0.080s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a7fe501-afda-4319-988d-db2ef1cddc5b req-250516ce-72f8-4b49-980d-51bf9e02e30f service nova] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] No waiting events found dispatching network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:24 user nova-compute[74441]: WARNING nova.compute.manager [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received unexpected event network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c for instance with vm_state building and task_state spawning.
Nov 09 00:38:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] No waiting events found dispatching network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:24 user nova-compute[74441]: WARNING nova.compute.manager [req-29d6a4b1-275b-4971-835b-cfb65e226346 req-48d7e522-174d-41b5-9c90-77dc681f7d9b service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received unexpected event network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c for instance with vm_state building and task_state spawning.
Nov 09 00:38:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:38:25 user nova-compute[74441]: INFO nova.compute.claims [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Claim successful on node user
Nov 09 00:38:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:38:26 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.policy [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca814243b0354c32bb5ed201bf8891d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d14ace0cb8b4ecfb0c1e76ba72480b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:38:26 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Creating image(s)
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "/opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "/opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "/opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.239s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:26 user nova-compute[74441]: WARNING nova.compute.manager [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 for instance with vm_state building and task_state spawning.
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:26 user nova-compute[74441]: WARNING nova.compute.manager [req-8e4bb804-7b1b-4d28-b432-ff71739be3c3 req-2c17bce8-2fb2-4e95-a115-e5c06f4a6b49 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 for instance with vm_state building and task_state spawning.
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk 1073741824" returned: 0 in 0.081s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Successfully created port: fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Cannot resize image /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Ensure instance console log exists: /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:27 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Instance spawned successfully.
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:27 user nova-compute[74441]: INFO nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Took 9.93 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:27 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:28 user nova-compute[74441]: INFO nova.compute.manager [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Took 10.62 seconds to build instance.
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a0ea2021-8a60-440c-acca-bf908400bbe0 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.742s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Successfully updated port: fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquired lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:38:28 user nova-compute[74441]: INFO nova.compute.claims [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Claim successful on node user
Nov 09 00:38:28 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Instance spawned successfully.
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:28 user nova-compute[74441]: INFO nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:28 user nova-compute[74441]: INFO nova.compute.manager [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Took 8.77 seconds to build instance.
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-29e37b93-9c66-4d6c-93ca-c913d66a3298 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.957s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updating instance_info_cache with network_info: [{"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Releasing lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Instance network_info: |[{"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Start _get_guest_xml network_info=[{"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:38:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-679113036',display_name='tempest-TestVolumeSwap-server-679113036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-679113036',id=5,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHgfL0mHcq1gx7SFm05ZgDvixwR9YiFpisQ8J/lVNa7MpgDaXe0w6omfOkFK4UoGtkLGxlEMm6+JfEQXsT2pXOd5byIZ7cmbqwuxUA/kbIlMqIl86vSc1FZ8J9Xtl542A==',key_name='tempest-keypair-1643188880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d14ace0cb8b4ecfb0c1e76ba72480b6',ramdisk_id='',reservation_id='r-4al1hrq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1457783965',owner_user_name='tempest-TestVolumeSwap-1457783965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca814243b0354c32bb5ed201bf8891d7',uuid=a35832ac-1910-4496-b14e-fcb99b973e41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Converting VIF {"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.objects.instance [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lazy-loading 'pci_devices' on Instance uuid a35832ac-1910-4496-b14e-fcb99b973e41 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.manager [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-changed-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.compute.manager [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Refreshing instance network info cache due to event network-changed-fde83601-62cf-49dc-bbbc-5354f20e0ef0. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] Acquiring lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] Acquired lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Refreshing network info cache for port fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:38:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:38:29 user nova-compute[74441]:   <uuid>a35832ac-1910-4496-b14e-fcb99b973e41</uuid>
Nov 09 00:38:29 user nova-compute[74441]:   <name>instance-00000005</name>
Nov 09 00:38:29 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:38:29 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:38:29 user nova-compute[74441]:   <metadata>
Nov 09 00:38:29 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:38:29 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:38:29 user nova-compute[74441]:       <nova:name>tempest-TestVolumeSwap-server-679113036</nova:name>
Nov 09 00:38:29 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:38:28</nova:creationTime>
Nov 09 00:38:29 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:38:29 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:38:29 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:38:29 user nova-compute[74441]:       <nova:owner>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:user uuid="ca814243b0354c32bb5ed201bf8891d7">tempest-TestVolumeSwap-1457783965-project-member</nova:user>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:project uuid="0d14ace0cb8b4ecfb0c1e76ba72480b6">tempest-TestVolumeSwap-1457783965</nova:project>
Nov 09 00:38:29 user nova-compute[74441]:       </nova:owner>
Nov 09 00:38:29 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:38:29 user nova-compute[74441]:       <nova:ports>
Nov 09 00:38:29 user nova-compute[74441]:         <nova:port uuid="fde83601-62cf-49dc-bbbc-5354f20e0ef0">
Nov 09 00:38:29 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 00:38:29 user nova-compute[74441]:         </nova:port>
Nov 09 00:38:29 user nova-compute[74441]:       </nova:ports>
Nov 09 00:38:29 user nova-compute[74441]:     </nova:instance>
Nov 09 00:38:29 user nova-compute[74441]:   </metadata>
Nov 09 00:38:29 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:38:29 user nova-compute[74441]:     <system>
Nov 09 00:38:29 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:38:29 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:38:29 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:38:29 user nova-compute[74441]:       <entry name="serial">a35832ac-1910-4496-b14e-fcb99b973e41</entry>
Nov 09 00:38:29 user nova-compute[74441]:       <entry name="uuid">a35832ac-1910-4496-b14e-fcb99b973e41</entry>
Nov 09 00:38:29 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:38:29 user nova-compute[74441]:     </system>
Nov 09 00:38:29 user nova-compute[74441]:   </sysinfo>
Nov 09 00:38:29 user nova-compute[74441]:   <os>
Nov 09 00:38:29 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:38:29 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:38:29 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:38:29 user nova-compute[74441]:   </os>
Nov 09 00:38:29 user nova-compute[74441]:   <features>
Nov 09 00:38:29 user nova-compute[74441]:     <acpi/>
Nov 09 00:38:29 user nova-compute[74441]:     <apic/>
Nov 09 00:38:29 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:38:29 user nova-compute[74441]:   </features>
Nov 09 00:38:29 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:38:29 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:38:29 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:38:29 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:38:29 user nova-compute[74441]:   </clock>
Nov 09 00:38:29 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:38:29 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:38:29 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:38:29 user nova-compute[74441]:   </cpu>
Nov 09 00:38:29 user nova-compute[74441]:   <devices>
Nov 09 00:38:29 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:38:29 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:38:29 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk"/>
Nov 09 00:38:29 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:38:29 user nova-compute[74441]:     </disk>
Nov 09 00:38:29 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:38:29 user nova-compute[74441]:       <mac address="fa:16:3e:9d:74:53"/>
Nov 09 00:38:29 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:29 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:38:29 user nova-compute[74441]:       <target dev="tapfde83601-62"/>
Nov 09 00:38:29 user nova-compute[74441]:     </interface>
Nov 09 00:38:29 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:38:29 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/console.log" append="off"/>
Nov 09 00:38:29 user nova-compute[74441]:     </serial>
Nov 09 00:38:29 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:38:29 user nova-compute[74441]:     <video>
Nov 09 00:38:29 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:29 user nova-compute[74441]:     </video>
Nov 09 00:38:29 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:38:29 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:38:29 user nova-compute[74441]:     </rng>
Nov 09 00:38:29 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:38:29 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:38:29 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:38:29 user nova-compute[74441]:     </memballoon>
Nov 09 00:38:29 user nova-compute[74441]:   </devices>
Nov 09 00:38:29 user nova-compute[74441]: </domain>
Nov 09 00:38:29 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-679113036',display_name='tempest-TestVolumeSwap-server-679113036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-679113036',id=5,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHgfL0mHcq1gx7SFm05ZgDvixwR9YiFpisQ8J/lVNa7MpgDaXe0w6omfOkFK4UoGtkLGxlEMm6+JfEQXsT2pXOd5byIZ7cmbqwuxUA/kbIlMqIl86vSc1FZ8J9Xtl542A==',key_name='tempest-keypair-1643188880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d14ace0cb8b4ecfb0c1e76ba72480b6',ramdisk_id='',reservation_id='r-4al1hrq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1457783965',owner_user_name='tempest-TestVolumeSwap-1457783965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca814243b0354c32bb5ed201bf8891d7',uuid=a35832ac-1910-4496-b14e-fcb99b973e41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Converting VIF {"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG os_vif [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80426cba-2a2f-563b-9693-fb3b9876090f', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfde83601-62, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfde83601-62, col_values=(('qos', UUID('6ef8e1dc-1b4c-426a-a3c2-c4a38064d20c')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfde83601-62, col_values=(('external_ids', {'iface-id': 'fde83601-62cf-49dc-bbbc-5354f20e0ef0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:74:53', 'vm-uuid': 'a35832ac-1910-4496-b14e-fcb99b973e41'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:29 user nova-compute[74441]: INFO os_vif [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62')
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] No VIF found with MAC fa:16:3e:9d:74:53, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:38:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.policy [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '154144f077d34d3fa6596ee14df5bdeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22bc50191ea845e992eea2c6f6af1682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:38:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Creating image(s)
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "/opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "/opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.network.neutron [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updated VIF entry in instance network info cache for port fde83601-62cf-49dc-bbbc-5354f20e0ef0. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG nova.network.neutron [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updating instance_info_cache with network_info: [{"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b7d9861c-21a6-40fa-bfd5-f5c26af661a7 req-80d74e96-b910-4410-b0e1-53a82fa029f6 service nova] Releasing lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.297s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.306s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk 1073741824" returned: 0 in 0.069s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Successfully created port: 4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.259s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Cannot resize image /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Ensure instance console log exists: /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-f78d24a8-0801-45b2-ae6c-6ecb8ed33ca9 req-a3913a32-e64c-4035-9835-fdeb6260c139 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f78d24a8-0801-45b2-ae6c-6ecb8ed33ca9 req-a3913a32-e64c-4035-9835-fdeb6260c139 service nova] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f78d24a8-0801-45b2-ae6c-6ecb8ed33ca9 req-a3913a32-e64c-4035-9835-fdeb6260c139 service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f78d24a8-0801-45b2-ae6c-6ecb8ed33ca9 req-a3913a32-e64c-4035-9835-fdeb6260c139 service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-f78d24a8-0801-45b2-ae6c-6ecb8ed33ca9 req-a3913a32-e64c-4035-9835-fdeb6260c139 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] No waiting events found dispatching network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:31 user nova-compute[74441]: WARNING nova.compute.manager [req-f78d24a8-0801-45b2-ae6c-6ecb8ed33ca9 req-a3913a32-e64c-4035-9835-fdeb6260c139 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received unexpected event network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 for instance with vm_state building and task_state spawning.
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Successfully updated port: 4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquired lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received event network-changed-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Refreshing instance network info cache due to event network-changed-4fb82ee0-f1a0-406d-9143-83a86f7c617a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] Acquiring lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updating instance_info_cache with network_info: [{"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Releasing lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Instance network_info: |[{"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] Acquired lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Refreshing network info cache for port 4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Start _get_guest_xml network_info=[{"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:38:32 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:32 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1851512831',display_name='tempest-VolumesAssistedSnapshotsTest-server-1851512831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1851512831',id=6,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKT9W7OGvFeXp6GY6B5zCp2Ntt0HiH0qrv90R4sE6bA/CjgPiyqJfvWIPGgppwYQslDGqLpYrqnx+GSbeExdvphMAeKr7XQDn+r0+rKg6nC8mu3gKlUN7x71+Xa6PKxsA==',key_name='tempest-keypair-395851799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22bc50191ea845e992eea2c6f6af1682',ramdisk_id='',reservation_id='r-2oy2iwbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1513411961',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1513411961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154144f077d34d3fa6596ee14df5bdeb',uuid=7e394947-6c4c-4724-a566-ea34b44dd220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Converting VIF {"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:38:32 user nova-compute[74441]:   <uuid>7e394947-6c4c-4724-a566-ea34b44dd220</uuid>
Nov 09 00:38:32 user nova-compute[74441]:   <name>instance-00000006</name>
Nov 09 00:38:32 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:38:32 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:38:32 user nova-compute[74441]:   <metadata>
Nov 09 00:38:32 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:38:32 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:38:32 user nova-compute[74441]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1851512831</nova:name>
Nov 09 00:38:32 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:38:32</nova:creationTime>
Nov 09 00:38:32 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:38:32 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:38:32 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:38:32 user nova-compute[74441]:       <nova:owner>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:user uuid="154144f077d34d3fa6596ee14df5bdeb">tempest-VolumesAssistedSnapshotsTest-1513411961-project-member</nova:user>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:project uuid="22bc50191ea845e992eea2c6f6af1682">tempest-VolumesAssistedSnapshotsTest-1513411961</nova:project>
Nov 09 00:38:32 user nova-compute[74441]:       </nova:owner>
Nov 09 00:38:32 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:38:32 user nova-compute[74441]:       <nova:ports>
Nov 09 00:38:32 user nova-compute[74441]:         <nova:port uuid="4fb82ee0-f1a0-406d-9143-83a86f7c617a">
Nov 09 00:38:32 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 00:38:32 user nova-compute[74441]:         </nova:port>
Nov 09 00:38:32 user nova-compute[74441]:       </nova:ports>
Nov 09 00:38:32 user nova-compute[74441]:     </nova:instance>
Nov 09 00:38:32 user nova-compute[74441]:   </metadata>
Nov 09 00:38:32 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:38:32 user nova-compute[74441]:     <system>
Nov 09 00:38:32 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:38:32 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:38:32 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:38:32 user nova-compute[74441]:       <entry name="serial">7e394947-6c4c-4724-a566-ea34b44dd220</entry>
Nov 09 00:38:32 user nova-compute[74441]:       <entry name="uuid">7e394947-6c4c-4724-a566-ea34b44dd220</entry>
Nov 09 00:38:32 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:38:32 user nova-compute[74441]:     </system>
Nov 09 00:38:32 user nova-compute[74441]:   </sysinfo>
Nov 09 00:38:32 user nova-compute[74441]:   <os>
Nov 09 00:38:32 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:38:32 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:38:32 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:38:32 user nova-compute[74441]:   </os>
Nov 09 00:38:32 user nova-compute[74441]:   <features>
Nov 09 00:38:32 user nova-compute[74441]:     <acpi/>
Nov 09 00:38:32 user nova-compute[74441]:     <apic/>
Nov 09 00:38:32 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:38:32 user nova-compute[74441]:   </features>
Nov 09 00:38:32 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:38:32 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:38:32 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:38:32 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:38:32 user nova-compute[74441]:   </clock>
Nov 09 00:38:32 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:38:32 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:38:32 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:38:32 user nova-compute[74441]:   </cpu>
Nov 09 00:38:32 user nova-compute[74441]:   <devices>
Nov 09 00:38:32 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:38:32 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:38:32 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk"/>
Nov 09 00:38:32 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:38:32 user nova-compute[74441]:     </disk>
Nov 09 00:38:32 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:38:32 user nova-compute[74441]:       <mac address="fa:16:3e:95:dc:8b"/>
Nov 09 00:38:32 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:32 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:38:32 user nova-compute[74441]:       <target dev="tap4fb82ee0-f1"/>
Nov 09 00:38:32 user nova-compute[74441]:     </interface>
Nov 09 00:38:32 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:38:32 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/console.log" append="off"/>
Nov 09 00:38:32 user nova-compute[74441]:     </serial>
Nov 09 00:38:32 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:38:32 user nova-compute[74441]:     <video>
Nov 09 00:38:32 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:32 user nova-compute[74441]:     </video>
Nov 09 00:38:32 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:38:32 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:38:32 user nova-compute[74441]:     </rng>
Nov 09 00:38:32 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:38:32 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:38:32 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:38:32 user nova-compute[74441]:     </memballoon>
Nov 09 00:38:32 user nova-compute[74441]:   </devices>
Nov 09 00:38:32 user nova-compute[74441]: </domain>
Nov 09 00:38:32 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1851512831',display_name='tempest-VolumesAssistedSnapshotsTest-server-1851512831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1851512831',id=6,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKT9W7OGvFeXp6GY6B5zCp2Ntt0HiH0qrv90R4sE6bA/CjgPiyqJfvWIPGgppwYQslDGqLpYrqnx+GSbeExdvphMAeKr7XQDn+r0+rKg6nC8mu3gKlUN7x71+Xa6PKxsA==',key_name='tempest-keypair-395851799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22bc50191ea845e992eea2c6f6af1682',ramdisk_id='',reservation_id='r-2oy2iwbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1513411961',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1513411961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154144f077d34d3fa6596ee14df5bdeb',uuid=7e394947-6c4c-4724-a566-ea34b44dd220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Converting VIF {"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG os_vif [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76257e3c-fdb6-5b9e-afe2-71d01c9691ef', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb82ee0-f1, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fb82ee0-f1, col_values=(('qos', UUID('03a2d4a9-1e77-45a8-9271-f6bfd632a260')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fb82ee0-f1, col_values=(('external_ids', {'iface-id': '4fb82ee0-f1a0-406d-9143-83a86f7c617a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:dc:8b', 'vm-uuid': '7e394947-6c4c-4724-a566-ea34b44dd220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:32 user nova-compute[74441]: INFO os_vif [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1')
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] No VIF found with MAC fa:16:3e:95:dc:8b, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:38:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.network.neutron [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updated VIF entry in instance network info cache for port 4fb82ee0-f1a0-406d-9143-83a86f7c617a. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.network.neutron [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updating instance_info_cache with network_info: [{"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5ec88dd-8de1-44be-93f9-484d59a0d01c req-b2366d12-36cb-4545-a933-91cbe0367a69 service nova] Releasing lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-2ef8d995-989f-4682-929c-02e59f6d0f1b req-d7bf7da4-a71a-4861-a52e-5f80c2e42e4c service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2ef8d995-989f-4682-929c-02e59f6d0f1b req-d7bf7da4-a71a-4861-a52e-5f80c2e42e4c service nova] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2ef8d995-989f-4682-929c-02e59f6d0f1b req-d7bf7da4-a71a-4861-a52e-5f80c2e42e4c service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2ef8d995-989f-4682-929c-02e59f6d0f1b req-d7bf7da4-a71a-4861-a52e-5f80c2e42e4c service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-2ef8d995-989f-4682-929c-02e59f6d0f1b req-d7bf7da4-a71a-4861-a52e-5f80c2e42e4c service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] No waiting events found dispatching network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:33 user nova-compute[74441]: WARNING nova.compute.manager [req-2ef8d995-989f-4682-929c-02e59f6d0f1b req-d7bf7da4-a71a-4861-a52e-5f80c2e42e4c service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received unexpected event network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 for instance with vm_state building and task_state spawning.
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Instance spawned successfully.
Nov 09 00:38:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:34 user nova-compute[74441]: INFO nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Took 7.74 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:34 user nova-compute[74441]: INFO nova.compute.manager [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Took 8.98 seconds to build instance.
Nov 09 00:38:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-46709391-5dd4-4060-97c4-a1e8cd40448f tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.361s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-f4e5bcf0-f352-4a8c-8410-ca031f108b36 req-6fd27196-d430-46f7-a6dc-568b6af390dd service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received event network-vif-plugged-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f4e5bcf0-f352-4a8c-8410-ca031f108b36 req-6fd27196-d430-46f7-a6dc-568b6af390dd service nova] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f4e5bcf0-f352-4a8c-8410-ca031f108b36 req-6fd27196-d430-46f7-a6dc-568b6af390dd service nova] Lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f4e5bcf0-f352-4a8c-8410-ca031f108b36 req-6fd27196-d430-46f7-a6dc-568b6af390dd service nova] Lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-f4e5bcf0-f352-4a8c-8410-ca031f108b36 req-6fd27196-d430-46f7-a6dc-568b6af390dd service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] No waiting events found dispatching network-vif-plugged-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:35 user nova-compute[74441]: WARNING nova.compute.manager [req-f4e5bcf0-f352-4a8c-8410-ca031f108b36 req-6fd27196-d430-46f7-a6dc-568b6af390dd service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received unexpected event network-vif-plugged-4fb82ee0-f1a0-406d-9143-83a86f7c617a for instance with vm_state building and task_state spawning.
Nov 09 00:38:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Instance spawned successfully.
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-a16d9f17-2b4d-49a5-8740-e98d218edeb2 req-4427302c-1843-4b7b-a3e1-efe083dcf143 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received event network-vif-plugged-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a16d9f17-2b4d-49a5-8740-e98d218edeb2 req-4427302c-1843-4b7b-a3e1-efe083dcf143 service nova] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a16d9f17-2b4d-49a5-8740-e98d218edeb2 req-4427302c-1843-4b7b-a3e1-efe083dcf143 service nova] Lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a16d9f17-2b4d-49a5-8740-e98d218edeb2 req-4427302c-1843-4b7b-a3e1-efe083dcf143 service nova] Lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-a16d9f17-2b4d-49a5-8740-e98d218edeb2 req-4427302c-1843-4b7b-a3e1-efe083dcf143 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] No waiting events found dispatching network-vif-plugged-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:37 user nova-compute[74441]: WARNING nova.compute.manager [req-a16d9f17-2b4d-49a5-8740-e98d218edeb2 req-4427302c-1843-4b7b-a3e1-efe083dcf143 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received unexpected event network-vif-plugged-4fb82ee0-f1a0-406d-9143-83a86f7c617a for instance with vm_state building and task_state spawning.
Nov 09 00:38:37 user nova-compute[74441]: INFO nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Took 8.11 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:37 user nova-compute[74441]: INFO nova.compute.manager [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Took 9.48 seconds to build instance.
Nov 09 00:38:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c5cb6531-f31a-4e7e-8709-34897be07313 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.818s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 00:38:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 00:38:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 00:38:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json" returned: 0 in 0.379s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:38:45 user nova-compute[74441]: INFO nova.compute.claims [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Claim successful on node user
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:38:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.policy [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e52582360c94d3baefc0c6dddcd5d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e88f3d5e07493b86f8d80a0245297e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:38:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Creating image(s)
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "/opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "/opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "/opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Successfully created port: 592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.642s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:47 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:47 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8079MB free_disk=25.5816650390625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk 1073741824" returned: 0 in 0.063s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.709s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 265471cf-50b2-4759-a485-fa5e2a4e50a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance f4bd46e4-44cb-4b47-9781-4adece881c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance a35832ac-1910-4496-b14e-fcb99b973e41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7e394947-6c4c-4724-a566-ea34b44dd220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 431c09e0-3913-46e9-8050-c5c6ac81be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:38:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Cannot resize image /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Ensure instance console log exists: /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Successfully updated port: 592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquired lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-changed-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Refreshing instance network info cache due to event network-changed-592ffed4-c218-4cf6-a1f4-1d89d11435c5. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] Acquiring lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updating instance_info_cache with network_info: [{"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Releasing lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Instance network_info: |[{"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] Acquired lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Refreshing network info cache for port 592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Start _get_guest_xml network_info=[{"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:38:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8504217',id=7,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9QoRd37pH4mv8XQwkhw2z42dojojTgWg89wZkdLYtFiJmASEqVgkqQ3FfmhPOM21E1fVoxRitz3WzWROX4wRYZrgXfh0w2LUEPvdkHu+baXbi6BOCptc3KedFoe7TCDg==',key_name='tempest-keypair-1743331967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0e88f3d5e07493b86f8d80a0245297e',ramdisk_id='',reservation_id='r-bhe3x4vj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1083770680',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e52582360c94d3baefc0c6dddcd5d5a',uuid=431c09e0-3913-46e9-8050-c5c6ac81be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Converting VIF {"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lazy-loading 'pci_devices' on Instance uuid 431c09e0-3913-46e9-8050-c5c6ac81be71 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:38:48 user nova-compute[74441]:   <uuid>431c09e0-3913-46e9-8050-c5c6ac81be71</uuid>
Nov 09 00:38:48 user nova-compute[74441]:   <name>instance-00000007</name>
Nov 09 00:38:48 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:38:48 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:38:48 user nova-compute[74441]:   <metadata>
Nov 09 00:38:48 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:38:48 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:38:48 user nova-compute[74441]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750</nova:name>
Nov 09 00:38:48 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:38:48</nova:creationTime>
Nov 09 00:38:48 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:38:48 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:38:48 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:38:48 user nova-compute[74441]:       <nova:owner>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:user uuid="2e52582360c94d3baefc0c6dddcd5d5a">tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member</nova:user>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:project uuid="d0e88f3d5e07493b86f8d80a0245297e">tempest-TestServerVolumeAttachScenarioOldVersion-1083770680</nova:project>
Nov 09 00:38:48 user nova-compute[74441]:       </nova:owner>
Nov 09 00:38:48 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:38:48 user nova-compute[74441]:       <nova:ports>
Nov 09 00:38:48 user nova-compute[74441]:         <nova:port uuid="592ffed4-c218-4cf6-a1f4-1d89d11435c5">
Nov 09 00:38:48 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 00:38:48 user nova-compute[74441]:         </nova:port>
Nov 09 00:38:48 user nova-compute[74441]:       </nova:ports>
Nov 09 00:38:48 user nova-compute[74441]:     </nova:instance>
Nov 09 00:38:48 user nova-compute[74441]:   </metadata>
Nov 09 00:38:48 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:38:48 user nova-compute[74441]:     <system>
Nov 09 00:38:48 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:38:48 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:38:48 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:38:48 user nova-compute[74441]:       <entry name="serial">431c09e0-3913-46e9-8050-c5c6ac81be71</entry>
Nov 09 00:38:48 user nova-compute[74441]:       <entry name="uuid">431c09e0-3913-46e9-8050-c5c6ac81be71</entry>
Nov 09 00:38:48 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:38:48 user nova-compute[74441]:     </system>
Nov 09 00:38:48 user nova-compute[74441]:   </sysinfo>
Nov 09 00:38:48 user nova-compute[74441]:   <os>
Nov 09 00:38:48 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:38:48 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:38:48 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:38:48 user nova-compute[74441]:   </os>
Nov 09 00:38:48 user nova-compute[74441]:   <features>
Nov 09 00:38:48 user nova-compute[74441]:     <acpi/>
Nov 09 00:38:48 user nova-compute[74441]:     <apic/>
Nov 09 00:38:48 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:38:48 user nova-compute[74441]:   </features>
Nov 09 00:38:48 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:38:48 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:38:48 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:38:48 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:38:48 user nova-compute[74441]:   </clock>
Nov 09 00:38:48 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:38:48 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:38:48 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:38:48 user nova-compute[74441]:   </cpu>
Nov 09 00:38:48 user nova-compute[74441]:   <devices>
Nov 09 00:38:48 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:38:48 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:38:48 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk"/>
Nov 09 00:38:48 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:38:48 user nova-compute[74441]:     </disk>
Nov 09 00:38:48 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:38:48 user nova-compute[74441]:       <mac address="fa:16:3e:b6:1a:1d"/>
Nov 09 00:38:48 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:48 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:38:48 user nova-compute[74441]:       <target dev="tap592ffed4-c2"/>
Nov 09 00:38:48 user nova-compute[74441]:     </interface>
Nov 09 00:38:48 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:38:48 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/console.log" append="off"/>
Nov 09 00:38:48 user nova-compute[74441]:     </serial>
Nov 09 00:38:48 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:38:48 user nova-compute[74441]:     <video>
Nov 09 00:38:48 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:38:48 user nova-compute[74441]:     </video>
Nov 09 00:38:48 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:38:48 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:38:48 user nova-compute[74441]:     </rng>
Nov 09 00:38:48 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:38:48 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:38:48 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:38:48 user nova-compute[74441]:     </memballoon>
Nov 09 00:38:48 user nova-compute[74441]:   </devices>
Nov 09 00:38:48 user nova-compute[74441]: </domain>
Nov 09 00:38:48 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8504217',id=7,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9QoRd37pH4mv8XQwkhw2z42dojojTgWg89wZkdLYtFiJmASEqVgkqQ3FfmhPOM21E1fVoxRitz3WzWROX4wRYZrgXfh0w2LUEPvdkHu+baXbi6BOCptc3KedFoe7TCDg==',key_name='tempest-keypair-1743331967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0e88f3d5e07493b86f8d80a0245297e',ramdisk_id='',reservation_id='r-bhe3x4vj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1083770680',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e52582360c94d3baefc0c6dddcd5d5a',uuid=431c09e0-3913-46e9-8050-c5c6ac81be71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Converting VIF {"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG os_vif [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d79e324-4a48-55de-9f03-28fe27b74f2c', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap592ffed4-c2, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap592ffed4-c2, col_values=(('qos', UUID('e936e9a7-6ab7-407b-b72d-325ee619ab92')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap592ffed4-c2, col_values=(('external_ids', {'iface-id': '592ffed4-c218-4cf6-a1f4-1d89d11435c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:1a:1d', 'vm-uuid': '431c09e0-3913-46e9-8050-c5c6ac81be71'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:48 user nova-compute[74441]: INFO os_vif [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2')
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:38:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] No VIF found with MAC fa:16:3e:b6:1a:1d, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.network.neutron [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updated VIF entry in instance network info cache for port 592ffed4-c218-4cf6-a1f4-1d89d11435c5. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.network.neutron [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updating instance_info_cache with network_info: [{"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-231eab02-f4e5-48aa-830d-837bb9e2fc7f req-bbee28b0-4f70-447c-bf68-ede5d3c26cb9 service nova] Releasing lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:38:49 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updating instance_info_cache with network_info: [{"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-84f7c9e9-5510-43ad-9b3e-b24e7a68e166" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-db885428-0600-45d7-b4a9-c9dc8285403b req-59dea021-6c04-4f23-a623-501234569116 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-db885428-0600-45d7-b4a9-c9dc8285403b req-59dea021-6c04-4f23-a623-501234569116 service nova] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-db885428-0600-45d7-b4a9-c9dc8285403b req-59dea021-6c04-4f23-a623-501234569116 service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-db885428-0600-45d7-b4a9-c9dc8285403b req-59dea021-6c04-4f23-a623-501234569116 service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-db885428-0600-45d7-b4a9-c9dc8285403b req-59dea021-6c04-4f23-a623-501234569116 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] No waiting events found dispatching network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:50 user nova-compute[74441]: WARNING nova.compute.manager [req-db885428-0600-45d7-b4a9-c9dc8285403b req-59dea021-6c04-4f23-a623-501234569116 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received unexpected event network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 for instance with vm_state building and task_state spawning.
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-51c3bcbd-79d6-4ec3-b7b4-95400dd47bdf req-b658bd9a-8d2a-49f3-a728-1dde3ccb9897 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-51c3bcbd-79d6-4ec3-b7b4-95400dd47bdf req-b658bd9a-8d2a-49f3-a728-1dde3ccb9897 service nova] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-51c3bcbd-79d6-4ec3-b7b4-95400dd47bdf req-b658bd9a-8d2a-49f3-a728-1dde3ccb9897 service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-51c3bcbd-79d6-4ec3-b7b4-95400dd47bdf req-b658bd9a-8d2a-49f3-a728-1dde3ccb9897 service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-51c3bcbd-79d6-4ec3-b7b4-95400dd47bdf req-b658bd9a-8d2a-49f3-a728-1dde3ccb9897 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] No waiting events found dispatching network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:38:52 user nova-compute[74441]: WARNING nova.compute.manager [req-51c3bcbd-79d6-4ec3-b7b4-95400dd47bdf req-b658bd9a-8d2a-49f3-a728-1dde3ccb9897 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received unexpected event network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 for instance with vm_state building and task_state spawning.
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:38:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Instance spawned successfully.
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:38:52 user nova-compute[74441]: INFO nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 09 00:38:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:38:52 user nova-compute[74441]: INFO nova.compute.manager [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Took 7.02 seconds to build instance.
Nov 09 00:38:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e1a9d41c-20e2-40e5-a8f9-95430a98acc7 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:38:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:38:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:39:26 user nova-compute[74441]: INFO nova.compute.claims [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Claim successful on node user
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:39:26 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:39:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:39:26 user nova-compute[74441]: INFO nova.virt.block_device [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Booting with volume 8540ef16-d3c0-427d-a8df-7e7eac6be287 at /dev/vda
Nov 09 00:39:27 user nova-compute[74441]: DEBUG os_brick.utils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:39:27 user nova-compute[74441]: INFO oslo.privsep.daemon [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpf5kl2_cq/privsep.sock']
Nov 09 00:39:27 user sudo[85239]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpf5kl2_cq/privsep.sock
Nov 09 00:39:27 user sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 00:39:27 user nova-compute[74441]: DEBUG nova.policy [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1bc19273fa047e7bec957c05a6f0e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b473302f384e4279a9d098c44eb31e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:39:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Successfully created port: 00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:39:28 user sudo[85239]: pam_unix(sudo:session): session closed for user root
Nov 09 00:39:28 user nova-compute[74441]: INFO oslo.privsep.daemon [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Spawned new privsep daemon via rootwrap
Nov 09 00:39:28 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 00:39:28 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 00:39:28 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 09 00:39:28 user nova-compute[74441]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85292
Nov 09 00:39:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e7cac-ab95-4605-8c4a-939e726ed636]: (2,) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6975745-7e59-45f4-9359-bdc2f5edb3e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:29 user nova-compute[74441]: WARNING os_brick.initiator.connectors.nvmeof [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f31cf49-d832-4857-8ad6-781d816a049b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf243ba-49fa-45fd-a54b-24cab94269f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e90e588-e366-4288-89ff-4828ea884081]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:39:29 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed77ef2-fd97-4245-98dd-b1538924ecfa]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG os_brick.utils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== get_connector_properties: return (2210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating existing volume attachment record: 21241049-402e-499c-b869-4bd1c1458878 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Successfully updated port: 00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquired lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-changed-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Refreshing instance network info cache due to event network-changed-00d12234-ef41-4e58-a03a-4180752d7d2f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] Acquiring lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating instance_info_cache with network_info: [{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Releasing lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance network_info: |[{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] Acquired lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:39:29 user nova-compute[74441]: DEBUG nova.network.neutron [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Refreshing network info cache for port 00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:39:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updated VIF entry in instance network info cache for port 00d12234-ef41-4e58-a03a-4180752d7d2f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:39:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating instance_info_cache with network_info: [{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:39:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7809e237-d5cb-4f49-a29f-ea4d5903d0fd req-64c83b1f-367c-42ac-9dd1-87ba25cdf327 service nova] Releasing lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:39:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:39:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:39:31 user nova-compute[74441]: INFO nova.compute.claims [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Claim successful on node user
Nov 09 00:39:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:39:32 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.policy [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8f2aaf1a8074b61838ece6cc77a8201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68981be0b4b94f7296294e7925cb295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:39:32 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Creating image(s)
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "/opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "/opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk 1073741824" returned: 0 in 0.054s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Successfully created port: 5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Cannot resize image /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Ensure instance console log exists: /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Successfully updated port: 5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquired lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-changed-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Refreshing instance network info cache due to event network-changed-5adb70c4-ff83-4670-8854-d462854faebe. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] Acquiring lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updating instance_info_cache with network_info: [{"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Releasing lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Instance network_info: |[{"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] Acquired lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Refreshing network info cache for port 5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Start _get_guest_xml network_info=[{"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:39:34 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:39:34 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1875781353',display_name='tempest-TestServerVolumeAttachmentScenario-server-1875781353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1875781353',id=9,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh7g85WaZ1lM2jaAfxvMzbz/olX34dnABo85gSFvW7c0v4xq1Opo2ThmXvHzubqZWCNB6abNhF44BR3vZDPywSn94ybo/bYVvDkafX3ifuicgmF3k4iAHMzY4F9gI7h+Q==',key_name='tempest-keypair-606405707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68981be0b4b94f7296294e7925cb295f',ramdisk_id='',reservation_id='r-lfi4lz81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1363956015',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1363956015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f2aaf1a8074b61838ece6cc77a8201',uuid=9c7f9274-3740-4dbc-83cb-20101ae1e734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Converting VIF {"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:39:34 user nova-compute[74441]:   <uuid>9c7f9274-3740-4dbc-83cb-20101ae1e734</uuid>
Nov 09 00:39:34 user nova-compute[74441]:   <name>instance-00000009</name>
Nov 09 00:39:34 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:39:34 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:39:34 user nova-compute[74441]:   <metadata>
Nov 09 00:39:34 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:39:34 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:39:34 user nova-compute[74441]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1875781353</nova:name>
Nov 09 00:39:34 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:39:34</nova:creationTime>
Nov 09 00:39:34 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:39:34 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:39:34 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:39:34 user nova-compute[74441]:       <nova:owner>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:user uuid="d8f2aaf1a8074b61838ece6cc77a8201">tempest-TestServerVolumeAttachmentScenario-1363956015-project-member</nova:user>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:project uuid="68981be0b4b94f7296294e7925cb295f">tempest-TestServerVolumeAttachmentScenario-1363956015</nova:project>
Nov 09 00:39:34 user nova-compute[74441]:       </nova:owner>
Nov 09 00:39:34 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:39:34 user nova-compute[74441]:       <nova:ports>
Nov 09 00:39:34 user nova-compute[74441]:         <nova:port uuid="5adb70c4-ff83-4670-8854-d462854faebe">
Nov 09 00:39:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:39:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:39:34 user nova-compute[74441]:       </nova:ports>
Nov 09 00:39:34 user nova-compute[74441]:     </nova:instance>
Nov 09 00:39:34 user nova-compute[74441]:   </metadata>
Nov 09 00:39:34 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:39:34 user nova-compute[74441]:     <system>
Nov 09 00:39:34 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:39:34 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:39:34 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:39:34 user nova-compute[74441]:       <entry name="serial">9c7f9274-3740-4dbc-83cb-20101ae1e734</entry>
Nov 09 00:39:34 user nova-compute[74441]:       <entry name="uuid">9c7f9274-3740-4dbc-83cb-20101ae1e734</entry>
Nov 09 00:39:34 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:39:34 user nova-compute[74441]:     </system>
Nov 09 00:39:34 user nova-compute[74441]:   </sysinfo>
Nov 09 00:39:34 user nova-compute[74441]:   <os>
Nov 09 00:39:34 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:39:34 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:39:34 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:39:34 user nova-compute[74441]:   </os>
Nov 09 00:39:34 user nova-compute[74441]:   <features>
Nov 09 00:39:34 user nova-compute[74441]:     <acpi/>
Nov 09 00:39:34 user nova-compute[74441]:     <apic/>
Nov 09 00:39:34 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:39:34 user nova-compute[74441]:   </features>
Nov 09 00:39:34 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:39:34 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:39:34 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:39:34 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:39:34 user nova-compute[74441]:   </clock>
Nov 09 00:39:34 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:39:34 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:39:34 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:39:34 user nova-compute[74441]:   </cpu>
Nov 09 00:39:34 user nova-compute[74441]:   <devices>
Nov 09 00:39:34 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:39:34 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:39:34 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk"/>
Nov 09 00:39:34 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:39:34 user nova-compute[74441]:     </disk>
Nov 09 00:39:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:39:34 user nova-compute[74441]:       <mac address="fa:16:3e:9a:b8:71"/>
Nov 09 00:39:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:39:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:39:34 user nova-compute[74441]:       <target dev="tap5adb70c4-ff"/>
Nov 09 00:39:34 user nova-compute[74441]:     </interface>
Nov 09 00:39:34 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:39:34 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/console.log" append="off"/>
Nov 09 00:39:34 user nova-compute[74441]:     </serial>
Nov 09 00:39:34 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:39:34 user nova-compute[74441]:     <video>
Nov 09 00:39:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:39:34 user nova-compute[74441]:     </video>
Nov 09 00:39:34 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:39:34 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:39:34 user nova-compute[74441]:     </rng>
Nov 09 00:39:34 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:39:34 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:39:34 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:39:34 user nova-compute[74441]:     </memballoon>
Nov 09 00:39:34 user nova-compute[74441]:   </devices>
Nov 09 00:39:34 user nova-compute[74441]: </domain>
Nov 09 00:39:34 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1875781353',display_name='tempest-TestServerVolumeAttachmentScenario-server-1875781353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1875781353',id=9,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh7g85WaZ1lM2jaAfxvMzbz/olX34dnABo85gSFvW7c0v4xq1Opo2ThmXvHzubqZWCNB6abNhF44BR3vZDPywSn94ybo/bYVvDkafX3ifuicgmF3k4iAHMzY4F9gI7h+Q==',key_name='tempest-keypair-606405707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68981be0b4b94f7296294e7925cb295f',ramdisk_id='',reservation_id='r-lfi4lz81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1363956015',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1363956015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f2aaf1a8074b61838ece6cc77a8201',uuid=9c7f9274-3740-4dbc-83cb-20101ae1e734,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Converting VIF {"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG os_vif [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23f51bf7-2494-5217-b498-0c3d54233a92', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5adb70c4-ff, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5adb70c4-ff, col_values=(('qos', UUID('735d77c7-2d81-4c1d-a20d-c5958ff38eb9')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5adb70c4-ff, col_values=(('external_ids', {'iface-id': '5adb70c4-ff83-4670-8854-d462854faebe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:b8:71', 'vm-uuid': '9c7f9274-3740-4dbc-83cb-20101ae1e734'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:34 user nova-compute[74441]: INFO os_vif [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff')
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No VIF found with MAC fa:16:3e:9a:b8:71, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updated VIF entry in instance network info cache for port 5adb70c4-ff83-4670-8854-d462854faebe. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updating instance_info_cache with network_info: [{"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:39:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-603464a3-8f46-46f6-8dfa-b7dd77212826 req-b962c1bf-c22e-444b-8de7-5ebb36922418 service nova] Releasing lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-36c852da-50f0-4315-9cf8-8bfdd541e540 req-7722bfc9-58ff-4d9f-aac0-f768d7926cf2 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36c852da-50f0-4315-9cf8-8bfdd541e540 req-7722bfc9-58ff-4d9f-aac0-f768d7926cf2 service nova] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36c852da-50f0-4315-9cf8-8bfdd541e540 req-7722bfc9-58ff-4d9f-aac0-f768d7926cf2 service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36c852da-50f0-4315-9cf8-8bfdd541e540 req-7722bfc9-58ff-4d9f-aac0-f768d7926cf2 service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-36c852da-50f0-4315-9cf8-8bfdd541e540 req-7722bfc9-58ff-4d9f-aac0-f768d7926cf2 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] No waiting events found dispatching network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:39:36 user nova-compute[74441]: WARNING nova.compute.manager [req-36c852da-50f0-4315-9cf8-8bfdd541e540 req-7722bfc9-58ff-4d9f-aac0-f768d7926cf2 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received unexpected event network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe for instance with vm_state building and task_state spawning.
Nov 09 00:39:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:39:38 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Instance spawned successfully.
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-5bb9199a-db50-4c6d-b2d8-b44fccb71277 req-b4c5da13-60bb-42c3-9c84-fa4a9cae5b2e service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5bb9199a-db50-4c6d-b2d8-b44fccb71277 req-b4c5da13-60bb-42c3-9c84-fa4a9cae5b2e service nova] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5bb9199a-db50-4c6d-b2d8-b44fccb71277 req-b4c5da13-60bb-42c3-9c84-fa4a9cae5b2e service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5bb9199a-db50-4c6d-b2d8-b44fccb71277 req-b4c5da13-60bb-42c3-9c84-fa4a9cae5b2e service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-5bb9199a-db50-4c6d-b2d8-b44fccb71277 req-b4c5da13-60bb-42c3-9c84-fa4a9cae5b2e service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] No waiting events found dispatching network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:39:38 user nova-compute[74441]: WARNING nova.compute.manager [req-5bb9199a-db50-4c6d-b2d8-b44fccb71277 req-b4c5da13-60bb-42c3-9c84-fa4a9cae5b2e service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received unexpected event network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe for instance with vm_state building and task_state spawning.
Nov 09 00:39:38 user nova-compute[74441]: INFO nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 09 00:39:38 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:39:38 user nova-compute[74441]: INFO nova.compute.manager [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Took 6.96 seconds to build instance.
Nov 09 00:39:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4529f3fb-3ecc-4edc-9071-55ba34b78545 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.070s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing instance network info cache due to event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:39:43 user nova-compute[74441]: DEBUG nova.network.neutron [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:39:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updated VIF entry in instance network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:39:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:39:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5f7db613-448e-4fb8-9a13-0fdf349b1a2f req-285d19f4-44a2-4dbe-b215-68672d2e92ad service nova] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:39:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG nova.objects.instance [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lazy-loading 'flavor' on Instance uuid 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:46 user nova-compute[74441]: INFO nova.compute.manager [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Attaching volume 2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 to /dev/vdb
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG os_brick.utils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2c1a84-b1da-4dda-92da-78f472107228]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe4541d-021b-4dd0-bbab-53cfb299fd16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87dd7bb-922e-49be-b946-64dcda4548ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e063a94-7ade-410c-acdb-f8726dfd4b41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:39:46 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1af3b2-a163-4ad9-b888-db0b8827a6d1]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG os_brick.utils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updating existing volume attachment record: 56e7e817-0d53-4b81-ba25-7368494e9ca9 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:39:50 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:39:50 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7638MB free_disk=25.455284118652344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 265471cf-50b2-4759-a485-fa5e2a4e50a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance f4bd46e4-44cb-4b47-9781-4adece881c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance a35832ac-1910-4496-b14e-fcb99b973e41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7e394947-6c4c-4724-a566-ea34b44dd220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 431c09e0-3913-46e9-8050-c5c6ac81be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ffd43df5-7473-4cbf-aac1-52711f08e730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:39:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:39:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:39:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:39:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:40:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Creating image(s)
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Ensure instance console log exists: /opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Start _get_guest_xml network_info=[{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffd43df5-7473-4cbf-aac1-52711f08e730', 'attached_at': '', 'detached_at': '', 'volume_id': '8540ef16-d3c0-427d-a8df-7e7eac6be287', 'serial': '8540ef16-d3c0-427d-a8df-7e7eac6be287'}, 'attachment_id': '21241049-402e-499c-b869-4bd1c1458878', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:40:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:40:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connector [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Factory for ISCSI on None {{(pid=74441) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:01 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:40:01 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:40:01 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b360004a-ccb1-4632-a134-7a5244002c84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:40:01 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[49af5833-087a-4d38-a4c5-4b21112f5fc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287] added
Nov 09 00:40:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf89a47f-4c20-46ed-8c0c-df1e67964f22]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab08ee3-4723-4a34-91c9-be8d05d16157]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZGaDVcB {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZGaDVcB" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de01d1fd-e955-4787-a4cd-2a0583e1fadf]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZGaDVcB'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f649dc0-62d1-494c-b3e6-3c8bac39abe3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c4bc95-0bb6-4cdf-8a03-c01977b35e13]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:40:01 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:40:01 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:40:01 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 00:40:01 user nova-compute[74441]: 
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880a1d5-3e26-48e7-9a81-62260d590b8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]
Nov 09 00:40:01 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.
Nov 09 00:40:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed6741-c10b-41d8-90c7-c13c30e66199]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50871d6-2a2e-4d06-a252-de74c59dbd84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:40:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da04445-93ba-492e-b686-b41587f146fd]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:40:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:40:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26334393934663061', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334393934663061', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-131231847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-131231847',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhNlCCZx6xii87AgroIHY4kUCQ+iFfYCnreRdGg2szTS8Xh+BOox5k6rsoS0vhTFKUMZFNqmluqNwT9TNCdC/4eRnP5Yt+l1XOe9CLT13M16/eqOS1scP3PQJ8uNIYBtw==',key_name='tempest-keypair-957284537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b473302f384e4279a9d098c44eb31e96',ramdisk_id='',reservation_id='r-cswotsek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-302690474',owner_user_name='tempest-ServerActionsV293TestJSON-302690474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1bc19273fa047e7bec957c05a6f0e4a',uuid=ffd43df5-7473-4cbf-aac1-52711f08e730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converting VIF {"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lazy-loading 'pci_devices' on Instance uuid ffd43df5-7473-4cbf-aac1-52711f08e730 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:40:03 user nova-compute[74441]:   <uuid>ffd43df5-7473-4cbf-aac1-52711f08e730</uuid>
Nov 09 00:40:03 user nova-compute[74441]:   <name>instance-00000008</name>
Nov 09 00:40:03 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:40:03 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:40:03 user nova-compute[74441]:   <metadata>
Nov 09 00:40:03 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:40:03 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:40:03 user nova-compute[74441]:       <nova:name>tempest-ServerActionsV293TestJSON-server-131231847</nova:name>
Nov 09 00:40:03 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:40:01</nova:creationTime>
Nov 09 00:40:03 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:40:03 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:40:03 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:40:03 user nova-compute[74441]:       <nova:owner>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:user uuid="b1bc19273fa047e7bec957c05a6f0e4a">tempest-ServerActionsV293TestJSON-302690474-project-member</nova:user>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:project uuid="b473302f384e4279a9d098c44eb31e96">tempest-ServerActionsV293TestJSON-302690474</nova:project>
Nov 09 00:40:03 user nova-compute[74441]:       </nova:owner>
Nov 09 00:40:03 user nova-compute[74441]:       <nova:ports>
Nov 09 00:40:03 user nova-compute[74441]:         <nova:port uuid="00d12234-ef41-4e58-a03a-4180752d7d2f">
Nov 09 00:40:03 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 00:40:03 user nova-compute[74441]:         </nova:port>
Nov 09 00:40:03 user nova-compute[74441]:       </nova:ports>
Nov 09 00:40:03 user nova-compute[74441]:     </nova:instance>
Nov 09 00:40:03 user nova-compute[74441]:   </metadata>
Nov 09 00:40:03 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:40:03 user nova-compute[74441]:     <system>
Nov 09 00:40:03 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:40:03 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:40:03 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:40:03 user nova-compute[74441]:       <entry name="serial">ffd43df5-7473-4cbf-aac1-52711f08e730</entry>
Nov 09 00:40:03 user nova-compute[74441]:       <entry name="uuid">ffd43df5-7473-4cbf-aac1-52711f08e730</entry>
Nov 09 00:40:03 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:40:03 user nova-compute[74441]:     </system>
Nov 09 00:40:03 user nova-compute[74441]:   </sysinfo>
Nov 09 00:40:03 user nova-compute[74441]:   <os>
Nov 09 00:40:03 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:40:03 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:40:03 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:40:03 user nova-compute[74441]:   </os>
Nov 09 00:40:03 user nova-compute[74441]:   <features>
Nov 09 00:40:03 user nova-compute[74441]:     <acpi/>
Nov 09 00:40:03 user nova-compute[74441]:     <apic/>
Nov 09 00:40:03 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:40:03 user nova-compute[74441]:   </features>
Nov 09 00:40:03 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:40:03 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:40:03 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:40:03 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:40:03 user nova-compute[74441]:   </clock>
Nov 09 00:40:03 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:40:03 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:40:03 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:40:03 user nova-compute[74441]:   </cpu>
Nov 09 00:40:03 user nova-compute[74441]:   <devices>
Nov 09 00:40:03 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:40:03 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:40:03 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 00:40:03 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:40:03 user nova-compute[74441]:       <serial>8540ef16-d3c0-427d-a8df-7e7eac6be287</serial>
Nov 09 00:40:03 user nova-compute[74441]:     </disk>
Nov 09 00:40:03 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:40:03 user nova-compute[74441]:       <mac address="fa:16:3e:9e:05:04"/>
Nov 09 00:40:03 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:40:03 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:40:03 user nova-compute[74441]:       <target dev="tap00d12234-ef"/>
Nov 09 00:40:03 user nova-compute[74441]:     </interface>
Nov 09 00:40:03 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:40:03 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730/console.log" append="off"/>
Nov 09 00:40:03 user nova-compute[74441]:     </serial>
Nov 09 00:40:03 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:40:03 user nova-compute[74441]:     <video>
Nov 09 00:40:03 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:40:03 user nova-compute[74441]:     </video>
Nov 09 00:40:03 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:40:03 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:40:03 user nova-compute[74441]:     </rng>
Nov 09 00:40:03 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:40:03 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:40:03 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:40:03 user nova-compute[74441]:     </memballoon>
Nov 09 00:40:03 user nova-compute[74441]:   </devices>
Nov 09 00:40:03 user nova-compute[74441]: </domain>
Nov 09 00:40:03 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-131231847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-131231847',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhNlCCZx6xii87AgroIHY4kUCQ+iFfYCnreRdGg2szTS8Xh+BOox5k6rsoS0vhTFKUMZFNqmluqNwT9TNCdC/4eRnP5Yt+l1XOe9CLT13M16/eqOS1scP3PQJ8uNIYBtw==',key_name='tempest-keypair-957284537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b473302f384e4279a9d098c44eb31e96',ramdisk_id='',reservation_id='r-cswotsek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-302690474',owner_user_name='tempest-ServerActionsV293TestJSON-302690474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:39:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1bc19273fa047e7bec957c05a6f0e4a',uuid=ffd43df5-7473-4cbf-aac1-52711f08e730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converting VIF {"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG os_vif [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0263af1e-56db-561c-bce3-4684bf9d48a5', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00d12234-ef, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00d12234-ef, col_values=(('qos', UUID('65237218-14ae-4730-9243-b7fa7ed6962f')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00d12234-ef, col_values=(('external_ids', {'iface-id': '00d12234-ef41-4e58-a03a-4180752d7d2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:05:04', 'vm-uuid': 'ffd43df5-7473-4cbf-aac1-52711f08e730'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: INFO os_vif [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef')
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] No VIF found with MAC fa:16:3e:9e:05:04, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:03 user nova-compute[74441]: INFO nova.compute.manager [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Shelving
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-ac4430aa-c0a7-4fb4-9ae7-9455f8544726 req-695cff22-799c-4a0c-a1b7-6c22c9a49800 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-unplugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ac4430aa-c0a7-4fb4-9ae7-9455f8544726 req-695cff22-799c-4a0c-a1b7-6c22c9a49800 service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ac4430aa-c0a7-4fb4-9ae7-9455f8544726 req-695cff22-799c-4a0c-a1b7-6c22c9a49800 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ac4430aa-c0a7-4fb4-9ae7-9455f8544726 req-695cff22-799c-4a0c-a1b7-6c22c9a49800 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-ac4430aa-c0a7-4fb4-9ae7-9455f8544726 req-695cff22-799c-4a0c-a1b7-6c22c9a49800 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-unplugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:04 user nova-compute[74441]: WARNING nova.compute.manager [req-ac4430aa-c0a7-4fb4-9ae7-9455f8544726 req-695cff22-799c-4a0c-a1b7-6c22c9a49800 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-unplugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state active and task_state shelving.
Nov 09 00:40:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance destroyed successfully.
Nov 09 00:40:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Beginning cold snapshot process
Nov 09 00:40:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk /opt/stack/data/nova/instances/snapshots/tmpy0_dhu4b/0c6075e32b2e4a7b801d2ace5ea81094 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e3f1741-7770-4dab-9c01-0348bf7b0805 req-7fb1e49f-d46f-4816-9f4b-a9ac55767e64 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e3f1741-7770-4dab-9c01-0348bf7b0805 req-7fb1e49f-d46f-4816-9f4b-a9ac55767e64 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e3f1741-7770-4dab-9c01-0348bf7b0805 req-7fb1e49f-d46f-4816-9f4b-a9ac55767e64 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e3f1741-7770-4dab-9c01-0348bf7b0805 req-7fb1e49f-d46f-4816-9f4b-a9ac55767e64 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e3f1741-7770-4dab-9c01-0348bf7b0805 req-7fb1e49f-d46f-4816-9f4b-a9ac55767e64 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:05 user nova-compute[74441]: WARNING nova.compute.manager [req-3e3f1741-7770-4dab-9c01-0348bf7b0805 req-7fb1e49f-d46f-4816-9f4b-a9ac55767e64 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state building and task_state spawning.
Nov 09 00:40:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk /opt/stack/data/nova/instances/snapshots/tmpy0_dhu4b/0c6075e32b2e4a7b801d2ace5ea81094" returned: 0 in 0.865s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Snapshot extracted, beginning image upload
Nov 09 00:40:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-967a54a1-d4d8-47bf-9ca9-960dfc5a9fe0 req-b837cc63-0bd2-4060-b349-513f4c4af684 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-967a54a1-d4d8-47bf-9ca9-960dfc5a9fe0 req-b837cc63-0bd2-4060-b349-513f4c4af684 service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-967a54a1-d4d8-47bf-9ca9-960dfc5a9fe0 req-b837cc63-0bd2-4060-b349-513f4c4af684 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-967a54a1-d4d8-47bf-9ca9-960dfc5a9fe0 req-b837cc63-0bd2-4060-b349-513f4c4af684 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-967a54a1-d4d8-47bf-9ca9-960dfc5a9fe0 req-b837cc63-0bd2-4060-b349-513f4c4af684 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:06 user nova-compute[74441]: WARNING nova.compute.manager [req-967a54a1-d4d8-47bf-9ca9-960dfc5a9fe0 req-b837cc63-0bd2-4060-b349-513f4c4af684 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state active and task_state shelving_image_uploading.
Nov 09 00:40:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:40:07 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance spawned successfully.
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9a4b79f-852e-4ab1-8042-8546fdc57c67 req-8844d005-de2c-4ffb-9f72-772ee1dcbe9c service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9a4b79f-852e-4ab1-8042-8546fdc57c67 req-8844d005-de2c-4ffb-9f72-772ee1dcbe9c service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9a4b79f-852e-4ab1-8042-8546fdc57c67 req-8844d005-de2c-4ffb-9f72-772ee1dcbe9c service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9a4b79f-852e-4ab1-8042-8546fdc57c67 req-8844d005-de2c-4ffb-9f72-772ee1dcbe9c service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9a4b79f-852e-4ab1-8042-8546fdc57c67 req-8844d005-de2c-4ffb-9f72-772ee1dcbe9c service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:07 user nova-compute[74441]: WARNING nova.compute.manager [req-f9a4b79f-852e-4ab1-8042-8546fdc57c67 req-8844d005-de2c-4ffb-9f72-772ee1dcbe9c service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state building and task_state spawning.
Nov 09 00:40:07 user nova-compute[74441]: INFO nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:40:07 user nova-compute[74441]: INFO nova.compute.manager [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Took 41.68 seconds to build instance.
Nov 09 00:40:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f4845c49-615e-48e3-9517-3d01c77ab28b tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.799s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-changed-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Refreshing instance network info cache due to event network-changed-3a0c3a06-c493-4f7a-8f30-961e9f20389c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] Acquiring lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] Acquired lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Refreshing network info cache for port 3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:08 user nova-compute[74441]: DEBUG nova.network.neutron [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updated VIF entry in instance network info cache for port 3a0c3a06-c493-4f7a-8f30-961e9f20389c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:08 user nova-compute[74441]: DEBUG nova.network.neutron [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updating instance_info_cache with network_info: [{"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bf8f74b5-064d-462e-b4fc-70f3d0451711 req-b59481d4-32f2-4822-98af-a50d8c21e365 service nova] Releasing lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:09 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Snapshot image upload complete
Nov 09 00:40:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:40:09 user nova-compute[74441]: INFO nova.compute.manager [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Shelve offloading
Nov 09 00:40:09 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance destroyed successfully.
Nov 09 00:40:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:40:09 user nova-compute[74441]: INFO nova.compute.claims [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Claim successful on node user
Nov 09 00:40:09 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:40:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:40:10 user nova-compute[74441]: INFO nova.virt.block_device [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Booting with volume 52df89ea-53bd-43d4-81d7-79cebfc2899b at /dev/vda
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_brick.utils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcda964a-3220-4221-88e9-b4daf93b4bd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceaff18-eb46-40c5-986d-0f6062ddd911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc26bbf-2936-4fd2-94a7-c7da2d65592b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5bc41-aeee-4552-9aa2-ef8ce42fc419]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:10 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3e0abc-9451-48d0-84d5-43232fc4fb84]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_brick.utils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating existing volume attachment record: 5922d4dc-e521-4410-9ea8-ec5d55e93cc2 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:40:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance destroyed successfully.
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'resources' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-88303642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-88303642',id=2,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU2K0OW+0sJ+wwOPgYhH0cv/tCXPXCJeBIP8GE3Z/9n5f7E63IgDULTOQpNDGvh0Hj9/dhOwj0uaLKCYDS/6dUQgUBVusLFERHApraybJANbOANs/xDMdQKEcLYp0yCew==',key_name='tempest-keypair-555090617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-xa6rl5bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member',shelved_at='2023-11-09T00:40:09.152551',shelved_host='user',shelved_image_id='2d94e410-7990-4d3d-9a75-e470aa954ae2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=d717ddbc-6c16-4b0b-812a-6cb46b5314dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG os_vif [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing instance network info cache due to event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.network.neutron [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap958e30c3-1b, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b86a7938-4966-4810-add9-0a6729453f25) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:10 user nova-compute[74441]: INFO os_vif [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b')
Nov 09 00:40:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Deleting instance files /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc_del
Nov 09 00:40:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Deletion of /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc_del complete
Nov 09 00:40:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74441) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 09 00:40:10 user nova-compute[74441]: INFO nova.virt.libvirt.host [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] UEFI support detected
Nov 09 00:40:11 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Deleted allocations for instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.policy [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26804e57dd3147418fb8986373a4563f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789f4722b46740f5909b90360503d651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'numa_topology' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<d717ddbc-6c16-4b0b-812a-6cb46b5314dc> lazy-loaded attributes: resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updated VIF entry in instance network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap958e30c3-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d0130adb-e027-4fd8-b673-085b1ed49966 req-a532dd9b-fdb8-4d8d-af29-a0210d0aa5fd service nova] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4fe1ef56-5a9a-47de-b0c0-52c9d420ccdf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.243s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-changed-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Refreshing instance network info cache due to event network-changed-791979c2-d197-4cdf-9d7a-a0a895ce47c6. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Refreshing network info cache for port 791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully created port: d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "interface-f4bd46e4-44cb-4b47-9781-4adece881c74-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "interface-f4bd46e4-44cb-4b47-9781-4adece881c74-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'flavor' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updated VIF entry in instance network info cache for port 791979c2-d197-4cdf-9d7a-a0a895ce47c6. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-91440888-c1dc-440a-9cb1-c198991effeb req-d5985653-e698-4ddd-955d-2045f8e9b763 service nova] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'pci_requests' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.objects.base [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Object Instance<f4bd46e4-44cb-4b47-9781-4adece881c74> lazy-loaded attributes: flavor,pci_requests {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully created port: b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:40:12 user nova-compute[74441]: DEBUG nova.policy [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adf38aba1dcf4d8e8cb89728ff19509b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce510b60b4e444f930d32c5301698d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:40:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully created port: c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:40:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Successfully created port: 2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully created port: 3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaiYzuBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:14 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:40:14 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:40:14 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[171989ad-75ae-4059-9908-00bb44e601c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:40:14 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd22b819-90e7-425f-8a7b-3dcad3bcaa39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772] added
Nov 09 00:40:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d77e90a-b63f-43c1-ace0-8dff6a688c08]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[069c0afc-673a-456d-a69b-d3a378fe05b3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PaiYzuBZ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PaiYzuBZ" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2722ed-1af9-498b-8bc4-fa985c77031c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PaiYzuBZ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03573e-9481-456e-97bd-6dda1513c6f3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df88e94-a194-40c5-b373-c18ba2f38d1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c55d1-5f08-4c77-a36b-593b4d4426dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260]
Nov 09 00:40:14 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260] successful.
Nov 09 00:40:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb03941-ad70-4c15-8ee1-318333ba5359]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[496566f2-1c7f-428f-88e6-75500800cb62]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:14 user nova-compute[74441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 (non-flash)
Nov 09 00:40:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:14 user nova-compute[74441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 (non-flash)
Nov 09 00:40:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ca342-6c75-48b1-bf85-9304a9b24dae]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaiYzuBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Successfully updated port: 2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-changed-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Refreshing instance network info cache due to event network-changed-2ab19211-0ca7-44bb-8e1e-4cbcafe02175. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully created port: 8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lazy-loading 'flavor' on Instance uuid 265471cf-50b2-4759-a485-fa5e2a4e50a8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '23331303964313738', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331303964313738', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lazy-loading 'flavor' on Instance uuid 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:40:15 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:40:15 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:40:15 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:40:15 user nova-compute[74441]:   <serial>2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772</serial>
Nov 09 00:40:15 user nova-compute[74441]: </disk>
Nov 09 00:40:15 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-d0ba3d80-8917-462f-991c-c2d0cc3cd435. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG nova.network.neutron [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:15 user nova-compute[74441]: INFO nova.compute.manager [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Attaching volume 6716a0b9-3922-4e10-874b-02f278ffa134 to /dev/sdc
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.neutron [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Refreshing network info cache for port 2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.neutron [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_vif [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35a0b762-41d7-508f-8817-71387e059273', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_brick.utils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ab19211-0c, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ab19211-0c, col_values=(('qos', UUID('b2bca67a-9643-4b37-953d-c53f2a6fb965')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ab19211-0c, col_values=(('external_ids', {'iface-id': '2ab19211-0ca7-44bb-8e1e-4cbcafe02175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:c5:99', 'vm-uuid': 'f4bd46e4-44cb-4b47-9781-4adece881c74'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:16 user nova-compute[74441]: INFO os_vif [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c')
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f5187-87d1-4894-9116-25f6d9cf5fb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] attach device xml: <interface type="ethernet">
Nov 09 00:40:16 user nova-compute[74441]:   <mac address="fa:16:3e:c6:c5:99"/>
Nov 09 00:40:16 user nova-compute[74441]:   <model type="virtio"/>
Nov 09 00:40:16 user nova-compute[74441]:   <mtu size="1442"/>
Nov 09 00:40:16 user nova-compute[74441]:   <target dev="tap2ab19211-0c"/>
Nov 09 00:40:16 user nova-compute[74441]: </interface>
Nov 09 00:40:16 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[439174eb-0f06-425f-bf75-ce3cf742cc0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e84310-5d09-49f6-bbbd-ab1df2b82422]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[634514b0-f57a-485f-963a-48d7b81239d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:16 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[548fbcef-1a98-466e-98e8-93a19b31d4ae]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG os_brick.utils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updating existing volume attachment record: e9d4e076-8bea-441c-b805-032c1003c8f3 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-changed-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Refreshing instance network info cache due to event network-changed-fde83601-62cf-49dc-bbbc-5354f20e0ef0. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] Acquiring lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] Acquired lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.neutron [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Refreshing network info cache for port fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] No VIF found with MAC fa:16:3e:25:8d:56, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.network.neutron [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f713c1ef-cdd1-407a-b00f-b3619d037bdb req-0883e3f2-99cc-4213-b8ec-cd21704e076c service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.objects.instance [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lazy-loading 'flavor' on Instance uuid a35832ac-1910-4496-b14e-fcb99b973e41 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.138s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-155973cf-0de8-4fe2-98fb-f327db1471b6 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.553s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No BDM found with device name hda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No VIF found with MAC fa:16:3e:d3:4b:2d, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:40:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:40:16 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:40:16 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:40:16 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:40:16</nova:creationTime>
Nov 09 00:40:16 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:40:16 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:40:16 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:40:16 user nova-compute[74441]:   <nova:owner>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:40:16 user nova-compute[74441]:   </nova:owner>
Nov 09 00:40:16 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:40:16 user nova-compute[74441]:   <nova:ports>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:40:16 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:40:16 user nova-compute[74441]:     </nova:port>
Nov 09 00:40:16 user nova-compute[74441]:     <nova:port uuid="2ab19211-0ca7-44bb-8e1e-4cbcafe02175">
Nov 09 00:40:16 user nova-compute[74441]:       <nova:ip type="fixed" address="10.10.10.128" ipVersion="4"/>
Nov 09 00:40:16 user nova-compute[74441]:     </nova:port>
Nov 09 00:40:16 user nova-compute[74441]:   </nova:ports>
Nov 09 00:40:16 user nova-compute[74441]: </nova:instance>
Nov 09 00:40:16 user nova-compute[74441]:  {{(pid=74441) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0173a9d8-4482-4245-889d-653719f1ea0f tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "interface-f4bd46e4-44cb-4b47-9781-4adece881c74-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.494s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updated VIF entry in instance network info cache for port fde83601-62cf-49dc-bbbc-5354f20e0ef0. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updating instance_info_cache with network_info: [{"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updated VIF entry in instance network info cache for port 2ab19211-0ca7-44bb-8e1e-4cbcafe02175. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-95ea7169-52db-4fa0-bedf-e3a08f4863c7 req-6caaa1cb-4b88-4a06-9998-d3359f9e0e31 service nova] Releasing lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-94cd2f31-eb6a-43ec-9e00-772f59eba567 req-3cc049fc-ec3f-47d2-8dfa-1ba9720d88e6 service nova] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: INFO nova.compute.manager [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Attaching volume 8a13ddf6-3803-45d8-af93-ba15414a5486 to /dev/vdb
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'flavor' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG os_brick.utils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a38136-7485-4960-8648-ecf2fb228122]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[332db973-d382-46fd-a2b5-d9a0c242bcff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[426325d9-5bda-462e-9bc9-670f9c526546]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17eab2-f09a-4fb4-9a2c-9b34564be8a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:17 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeaffae-91d6-46af-9d48-e7e61b137ead]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG os_brick.utils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updating existing volume attachment record: 43066f1d-62c2-4ad1-915a-5e31a363ba75 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:17 user nova-compute[74441]: INFO nova.compute.manager [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Terminating instance
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: INFO nova.compute.manager [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Attaching volume e363087c-4249-4343-ac83-0421d5e01f50 to /dev/vdb
Nov 09 00:40:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:17 user nova-compute[74441]: WARNING nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 for instance with vm_state active and task_state None.
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:17 user nova-compute[74441]: WARNING nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 for instance with vm_state active and task_state None.
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-b68cc496-94c2-4b1e-8948-ae38830f1f31. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-vif-unplugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] No waiting events found dispatching network-vif-unplugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-vif-unplugged-482cee9a-dd80-4045-8899-c225ec471a01 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] Acquiring lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] No waiting events found dispatching network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:40:18 user nova-compute[74441]: WARNING nova.compute.manager [req-474972da-4385-4f21-80ca-90d715d179c5 req-2e6fec2c-61c5-493d-8688-18d754ce1175 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received unexpected event network-vif-plugged-482cee9a-dd80-4045-8899-c225ec471a01 for instance with vm_state active and task_state deleting.
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Instance destroyed successfully.
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lazy-loading 'resources' on Instance uuid 84f7c9e9-5510-43ad-9b3e-b24e7a68e166 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:37:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1711349661',display_name='tempest-DeleteServersTestJSON-server-1711349661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1711349661',id=1,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d039eb675084c51bafa66f59e350803',ramdisk_id='',reservation_id='r-hpykz79o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1580679555',owner_user_name='tempest-DeleteServersTestJSON-1580679555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:03Z,user_data=None,user_id='73d2834f21dc4cc6840a537897051f26',uuid=84f7c9e9-5510-43ad-9b3e-b24e7a68e166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Converting VIF {"id": "482cee9a-dd80-4045-8899-c225ec471a01", "address": "fa:16:3e:25:8d:56", "network": {"id": "fe4ee8cf-721d-4702-95d5-687c45ab6413", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1532786238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d039eb675084c51bafa66f59e350803", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482cee9a-dd", "ovs_interfaceid": "482cee9a-dd80-4045-8899-c225ec471a01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_vif [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap482cee9a-dd, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1e8aeb9-7ee0-4116-8815-c05db8cb9909) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:40:18 user nova-compute[74441]: INFO os_vif [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:8d:56,bridge_name='br-int',has_traffic_filtering=True,id=482cee9a-dd80-4045-8899-c225ec471a01,network=Network(fe4ee8cf-721d-4702-95d5-687c45ab6413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482cee9a-dd')
Nov 09 00:40:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PaiYzuBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:18 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f96417-a652-476f-b13b-021c1023fcc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:40:18 user nova-compute[74441]: No targets found.
Nov 09 00:40:18 user nova-compute[74441]: iSNS:
Nov 09 00:40:18 user nova-compute[74441]: No targets found.
Nov 09 00:40:18 user nova-compute[74441]: STATIC:
Nov 09 00:40:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772
Nov 09 00:40:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:40:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:40:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287
Nov 09 00:40:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:40:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:40:18 user nova-compute[74441]: FIRMWARE:
Nov 09 00:40:18 user nova-compute[74441]: No targets found.
Nov 09 00:40:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:40:18 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:40:18 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec85be06-be81-48b4-bfd7-7a5078df92d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6127f-8949-4613-a788-8e8341e8c390]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:18 user nova-compute[74441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 (non-flash)
Nov 09 00:40:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:40:18 user nova-compute[74441]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 (non-flash)
Nov 09 00:40:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c43f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3345f8-4b23-4dda-876b-0c9e817f5ce1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e0bf16-25e9-40f0-9afe-b381dd2dca30]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8824c070-543e-4e23-ad4a-3bc842f0fbca]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[484140e4-c6e9-4b1a-8ec8-18e301c143e5]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1dd1c2-ce19-468b-ae94-f0dce9e1d63f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[355ccd9a-1fec-4913-b729-6bc12e68f9d3]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260]
Nov 09 00:40:19 user nova-compute[74441]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772, portal: 172.16.0.220,3260] successful.
Nov 09 00:40:19 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aeb9fd4-7c2a-4a23-a6f0-cccb3bbef772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f95a657-212a-4005-8486-7d2be8677fd8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] <== disconnect_volume: return (430ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:40:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Deleting instance files /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166_del
Nov 09 00:40:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Deletion of /opt/stack/data/nova/instances/84f7c9e9-5510-43ad-9b3e-b24e7a68e166_del complete
Nov 09 00:40:19 user nova-compute[74441]: INFO nova.compute.manager [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-acf304c2-5b24-48f8-bd04-50e61e1ab05e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6ef16281-f11b-4c3a-8638-feab2c6adf2f req-b17f0658-308a-490b-a098-1dd63f7efffe service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-b2c21445-4dc4-45a4-80a0-20c5377f3ab9. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:20 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Took 1.24 seconds to deallocate network for instance.
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: 3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received event network-changed-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Refreshing instance network info cache due to event network-changed-4fb82ee0-f1a0-406d-9143-83a86f7c617a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] Acquiring lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] Acquired lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Refreshing network info cache for port 4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04745fb9-d046-4427-ae16-e9b751beefdf req-ea4e66b7-e06e-495c-9255-f7c6aa16de11 service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG nova.network.neutron [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updated VIF entry in instance network info cache for port 4fb82ee0-f1a0-406d-9143-83a86f7c617a. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG nova.network.neutron [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updating instance_info_cache with network_info: [{"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] Releasing lock "refresh_cache-7e394947-6c4c-4724-a566-ea34b44dd220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-4de29d94-5f35-463f-b1bb-1befc3452a9c req-4ba7cf3e-b13b-48a8-a357-324cc25b4418 service nova] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Received event network-vif-deleted-482cee9a-dd80-4045-8899-c225ec471a01 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Successfully updated port: 8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:40:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:40:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.network.neutron [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance network_info: |[{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port 3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updated VIF entry in instance network info cache for port 3fa7df24-0caa-4bc8-9a42-d3ae43cf157a. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port 8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updated VIF entry in instance network info cache for port 8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8dfce25-cee8-4b37-91d0-4a66ca030e29 req-c1296ebb-2588-42a7-92a6-c2798a916c78 service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-changed-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:40:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Refreshing instance network info cache due to event network-changed-592ffed4-c218-4cf6-a1f4-1d89d11435c5. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:40:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] Acquiring lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] Acquired lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Refreshing network info cache for port 592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updated VIF entry in instance network info cache for port 592ffed4-c218-4cf6-a1f4-1d89d11435c5. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updating instance_info_cache with network_info: [{"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d3947c5f-212d-46d1-a389-f83af96d2b2e req-76da6ea7-4acc-4fd1-9521-b57cf2e3c5de service nova] Releasing lock "refresh_cache-431c09e0-3913-46e9-8050-c5c6ac81be71" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lazy-loading 'flavor' on Instance uuid 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:40:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:38 user nova-compute[74441]: INFO nova.compute.manager [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] [instance: 84f7c9e9-5510-43ad-9b3e-b24e7a68e166] Took 18.29 seconds to detach 1 volumes for instance.
Nov 09 00:40:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.utils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d1861-7bca-4ad1-afd4-6920fec11c44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce182a00-327f-471c-8dcb-7186268dd08f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b20aab4-dfad-4ade-bcca-6baf2b050e61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: INFO nova.virt.block_device [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Booting with volume 873e0202-35eb-4455-9a20-cf1f26aff8f6 at /dev/vdb
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c12651c-306c-468f-94f8-f3540e136a4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.volume.cinder [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Update attachment failed for attachment 43066f1d-62c2-4ad1-915a-5e31a363ba75. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4b135bff-3ae7-4241-be43-48afc282289b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4b135bff-3ae7-4241-be43-48afc282289b)
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:40:39 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Deleted allocations for instance 84f7c9e9-5510-43ad-9b3e-b24e7a68e166
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:39 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2faa9-89d3-4996-9fa2-6ba39ee2dbdd]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.utils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating existing volume attachment record: 656ff13e-819c-43b1-b00e-f59a9043ff84 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Failed to attach 8a13ddf6-3803-45d8-af93-ba15414a5486 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4b135bff-3ae7-4241-be43-48afc282289b)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Traceback (most recent call last):
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     self._do_attach(context, instance, volume, volume_api,
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     self._volume_attach(context, volume, connector, instance,
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     connection_info = volume_api.attachment_update(
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     res = method(self, ctx, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     return method.func(obj, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     resp = self._update('/attachments/%s' % id, body)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     return self.request(url, method, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41]     raise exceptions.from_response(resp, body)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4b135bff-3ae7-4241-be43-48afc282289b)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: a35832ac-1910-4496-b14e-fcb99b973e41] 
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aaf5c886-3cdf-479b-a218-e39998986447 tempest-DeleteServersTestJSON-1580679555 tempest-DeleteServersTestJSON-1580679555-project-member] Lock "84f7c9e9-5510-43ad-9b3e-b24e7a68e166" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.606s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:39 user nova-compute[74441]: INFO nova.compute.manager [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Attaching volume 51e7a449-5670-4a48-b4e8-3e5c750453db to /dev/vdb
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.133s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server [None req-60358d7b-8494-4c30-89df-6daabc3ec78a tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4b135bff-3ae7-4241-be43-48afc282289b)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4b135bff-3ae7-4241-be43-48afc282289b)
Nov 09 00:40:39 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.volume.cinder [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Update attachment failed for attachment e9d4e076-8bea-441c-b805-032c1003c8f3. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dcce7af8-acc9-420c-81dc-7fd74e51b8ae) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dcce7af8-acc9-420c-81dc-7fd74e51b8ae)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Failed to attach 6716a0b9-3922-4e10-874b-02f278ffa134 at /dev/sdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dcce7af8-acc9-420c-81dc-7fd74e51b8ae)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Traceback (most recent call last):
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     self._do_attach(context, instance, volume, volume_api,
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     self._volume_attach(context, volume, connector, instance,
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     connection_info = volume_api.attachment_update(
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     res = method(self, ctx, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     with excutils.save_and_reraise_exception():
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     self.force_reraise()
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     raise self.value
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     return method.func(obj, *args, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     resp = self._update('/attachments/%s' % id, body)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     return self.request(url, method, **kwargs)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8]     raise exceptions.from_response(resp, body)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dcce7af8-acc9-420c-81dc-7fd74e51b8ae)
Nov 09 00:40:39 user nova-compute[74441]: ERROR nova.compute.manager [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] 
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.utils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e1fe94-abfb-4bbd-8b7a-5124db1a3b69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e471c76d-0a5f-46e7-8837-4eaa3363a0a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7fb5b0-d9d4-4f97-b324-ed7cb793de6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c279af1-91cf-47fd-9671-b0396d21d43b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.utils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:39 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[775ff8f8-f162-4ec4-87f3-9d94e33e75a5]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG os_brick.utils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating existing volume attachment record: f908fb42-af55-42c4-a6bb-6eb4cb12bc29 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e18b9-28c3-4c8b-a6e1-53c6f901db20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.952s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89733b-b7e3-488f-a6bc-b0e2a14a47d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6673f9d-f0cc-483d-8b07-9035368e235a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702e7d5-075a-4447-8c1b-9142e53fd52d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server [None req-788b47f3-bce6-406c-81a4-374e6bb41788 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dcce7af8-acc9-420c-81dc-7fd74e51b8ae)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dcce7af8-acc9-420c-81dc-7fd74e51b8ae)
Nov 09 00:40:40 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:40:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:40:40 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:40:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ec6f1-9547-4e97-a1a8-6d868ca44a9e]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG os_brick.utils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:40:40 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updating existing volume attachment record: 6548464d-f45d-452b-8586-d67e5f9e529a {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:40:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:40:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updating instance_info_cache with network_info: [{"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-265471cf-50b2-4759-a485-fa5e2a4e50a8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:40:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:40:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:40:50 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:40:50 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=25.41259765625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 265471cf-50b2-4759-a485-fa5e2a4e50a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance f4bd46e4-44cb-4b47-9781-4adece881c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance a35832ac-1910-4496-b14e-fcb99b973e41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7e394947-6c4c-4724-a566-ea34b44dd220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 431c09e0-3913-46e9-8050-c5c6ac81be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ffd43df5-7473-4cbf-aac1-52711f08e730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6e7a69cc-14e9-4a6f-b736-e74de84f8220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:40:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:40:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:40:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:40:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:41:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:41:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:41:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:05 user nova-compute[74441]: INFO nova.virt.block_device [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Booting with volume 60873b71-53b8-4337-b171-07c6cae1a255 at /dev/vdc
Nov 09 00:41:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkIFxQYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:05 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:05 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:05 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d329bd2-6b9a-4ca8-afa8-96c4d5ff9538]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:41:05 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed66b30-057e-4404-a8e6-c897f28751b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db] added
Nov 09 00:41:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a0a13-9184-41f0-9f53-146697909953]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[307e579b-e3a2-4c2f-9856-815f87a84a14]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkIFxQYi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.utils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkIFxQYi" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed5bbb-70dc-46e5-a31b-c241d1a76d04]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkIFxQYi'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6459461a-a3d1-4256-8e8f-fb09beed7af9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lazy-loading 'flavor' on Instance uuid 431c09e0-3913-46e9-8050-c5c6ac81be71 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69fd140-a742-4aea-95e1-6360fcaa171b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dba6e5-4f31-4f25-a283-d883291d8da9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6807cbfe-d8aa-4a36-beba-463fbde46e43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f8ec8-d658-480a-a0b2-503bb2c23936]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e7555d-487e-47d8-9552-a5c0beda0e6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af1588f-0d7d-4f8e-b979-e4b32addb5e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260]
Nov 09 00:41:05 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:05 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbed14b-d754-43cb-8566-a7220b2f65ec]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.utils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating existing volume attachment record: 1bb98f5a-e78f-46de-8033-b184595ec318 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f5b1b-5267-4246-ae61-f11661a3c067]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3f0b78-4b2a-40a9-a8ba-691b12dc8578]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:05 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:05 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfecf334-a605-490d-a8fd-7fae44509fac]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkIFxQYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:05 user nova-compute[74441]: INFO nova.compute.manager [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Attaching volume bedb68b7-f430-4ab4-8aff-45e4278340c4 to /dev/vdb
Nov 09 00:41:05 user nova-compute[74441]: DEBUG os_brick.utils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11d9085-ed31-446f-979c-162d2d73f57e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5bfbe8-c0c5-4f00-847a-078a9e6444d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8ef02c-85df-44e0-a4e9-e2e7cd2c5320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d149ea0a-db2c-4fd5-b614-f9348ffecf54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:06 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:41:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e0e916-70fb-4163-8ec7-b01c8a47c0ae]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.utils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updating existing volume attachment record: 444c19b7-69ab-4da2-a053-cc872c5bafd5 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23565356666663565', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565356666663565', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lazy-loading 'flavor' on Instance uuid 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] attach device xml: <disk type="block" device="disk">
Nov 09 00:41:06 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:06 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:41:06 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:06 user nova-compute[74441]:   <serial>51e7a449-5670-4a48-b4e8-3e5c750453db</serial>
Nov 09 00:41:06 user nova-compute[74441]: </disk>
Nov 09 00:41:06 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:41:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] No VIF found with MAC fa:16:3e:95:dc:8b, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:41:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-changed-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Refreshing instance network info cache due to event network-changed-00d12234-ef41-4e58-a03a-4180752d7d2f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:41:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] Acquiring lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:41:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] Acquired lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:41:16 user nova-compute[74441]: DEBUG nova.network.neutron [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Refreshing network info cache for port 00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:41:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updated VIF entry in instance network info cache for port 00d12234-ef41-4e58-a03a-4180752d7d2f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:41:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating instance_info_cache with network_info: [{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:41:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b3510db1-abc6-471e-855b-bc8edb9ecee1 req-ed1aad05-29c7-4385-8d67-8de738bc46f3 service nova] Releasing lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:41:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:41:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:41:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:41:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-changed-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Refreshing instance network info cache due to event network-changed-5adb70c4-ff83-4670-8854-d462854faebe. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:41:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] Acquiring lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:41:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] Acquired lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:41:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Refreshing network info cache for port 5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:41:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updated VIF entry in instance network info cache for port 5adb70c4-ff83-4670-8854-d462854faebe. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:41:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updating instance_info_cache with network_info: [{"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:41:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b313a30-64e0-45b5-9376-5e33af69849e req-6f5785fa-f70b-4171-b50e-376537c891db service nova] Releasing lock "refresh_cache-9c7f9274-3740-4dbc-83cb-20101ae1e734" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:41:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2cd66c96-e4f5-4635-a638-b97398f8eed0 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.598s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:41:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Creating image(s)
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Ensure instance console log exists: /opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Start _get_guest_xml network_info=[{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQcORjXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e7a69cc-14e9-4a6f-b736-e74de84f8220', 'attached_at': '', 'detached_at': '', 'volume_id': '52df89ea-53bd-43d4-81d7-79cebfc2899b', 'serial': '52df89ea-53bd-43d4-81d7-79cebfc2899b'}, 'attachment_id': '5922d4dc-e521-4410-9ea8-ec5d55e93cc2', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmlDLRhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e7a69cc-14e9-4a6f-b736-e74de84f8220', 'attached_at': '', 'detached_at': '', 'volume_id': '873e0202-35eb-4455-9a20-cf1f26aff8f6', 'serial': '873e0202-35eb-4455-9a20-cf1f26aff8f6'}, 'attachment_id': 'f908fb42-af55-42c4-a6bb-6eb4cb12bc29', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMUvFQnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6e7a69cc-14e9-4a6f-b736-e74de84f8220', 'attached_at': '', 'detached_at': '', 'volume_id': '60873b71-53b8-4337-b171-07c6cae1a255', 'serial': '60873b71-53b8-4337-b171-07c6cae1a255'}, 'attachment_id': '1bb98f5a-e78f-46de-8033-b184595ec318', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:41:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:41:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQcORjXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:31 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:31 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:31 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5250f-a4b1-4256-ad8b-157ef84eb14e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:41:31 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bbf6fa-5c32-4857-99e9-c23fcbd188e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b] added
Nov 09 00:41:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[83161ec9-f996-40c2-bcab-a3f63e608982]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25b2d2a-9004-4b91-8d2e-5ed3d4cdc57e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQcORjXa {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gQcORjXa" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f07612-7878-4b9b-8683-d95b4b075520]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gQcORjXa'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d73834a-67ff-4ffe-9fde-1dd794533ef5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea72dec3-dce3-4bd9-96ad-bf34c0b9df80]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:31 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:31 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e291d113-f890-4668-a5d3-96ec725d5b2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260]
Nov 09 00:41:31 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'flavor' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[44456b96-2772-43c2-be43-4c4bf7644a80]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abad9a1-5bfa-45e4-89a6-f1ec881bf20d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:31 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:31 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:31 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:31 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cb3d14-2762-4e93-a052-26738ba3d723]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:41:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQcORjXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:32 user nova-compute[74441]: INFO nova.compute.manager [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attaching volume ce983810-1854-4cf1-8f5c-4ea7af02fd98 to /dev/vdb
Nov 09 00:41:32 user nova-compute[74441]: INFO nova.compute.manager [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Rebuilding instance
Nov 09 00:41:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23665386665343830', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665386665343830', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-00f33880-960d-4800-9ff5-2bffaaf4ada6 req-a9c3fcdb-0514-4839-90b4-cfa09a70bb8c service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00f33880-960d-4800-9ff5-2bffaaf4ada6 req-a9c3fcdb-0514-4839-90b4-cfa09a70bb8c service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00f33880-960d-4800-9ff5-2bffaaf4ada6 req-a9c3fcdb-0514-4839-90b4-cfa09a70bb8c service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00f33880-960d-4800-9ff5-2bffaaf4ada6 req-a9c3fcdb-0514-4839-90b4-cfa09a70bb8c service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-00f33880-960d-4800-9ff5-2bffaaf4ada6 req-a9c3fcdb-0514-4839-90b4-cfa09a70bb8c service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:32 user nova-compute[74441]: WARNING nova.compute.manager [req-00f33880-960d-4800-9ff5-2bffaaf4ada6 req-a9c3fcdb-0514-4839-90b4-cfa09a70bb8c service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state rebuilding.
Nov 09 00:41:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmlDLRhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:32 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[746a8488-42bb-41fa-b12f-1ac1a05bdf0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:41:32 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac981c5-1816-42d8-bc58-258654866ffe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6] added
Nov 09 00:41:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ba4b8-42a8-4b44-936c-436267b37204]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54484bc-9381-464b-b33c-565ccca5c0af]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmlDLRhA {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XmlDLRhA" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088e2e9-ccf5-4e78-a084-f069f21710d1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XmlDLRhA'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249b8ab-d39c-4b69-b398-70a26c3424ea]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6b30f9-fada-4a02-a143-cc482e654428]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:32 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:32 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:32 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:32 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG os_brick.utils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3494018f-7e76-4f71-a712-991276d79ae3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e696c6d0-a81b-4b03-8d71-e73e7a816e9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39a1dc5-10d4-43a5-88b3-a81b266d363f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260]
Nov 09 00:41:33 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723a352-e744-46d9-9a34-ca7bb945d718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58033c95-841e-4f88-89bf-3760a95143a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ec04c-4419-400a-b8b3-d1f4014f28f5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:33 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[374db417-2615-4535-aae9-64a67b574c41]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aecd1c-8469-4fd3-9ae7-81b02a6f1952]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.utils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updating existing volume attachment record: e963843a-62d1-465a-b16c-0bb6b7ca88f4 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:33 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:33 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:33 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:33 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:33 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:33 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb10805-9383-44d1-9733-9a4b7e95bf47]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmlDLRhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:41:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance destroyed successfully.
Nov 09 00:41:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance destroyed successfully.
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1328300774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-131231847',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhNlCCZx6xii87AgroIHY4kUCQ+iFfYCnreRdGg2szTS8Xh+BOox5k6rsoS0vhTFKUMZFNqmluqNwT9TNCdC/4eRnP5Yt+l1XOe9CLT13M16/eqOS1scP3PQJ8uNIYBtw==',key_name='tempest-keypair-957284537',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b473302f384e4279a9d098c44eb31e96',ramdisk_id='',reservation_id='r-cswotsek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-302690474',owner_user_name='tempest-ServerActionsV293TestJSON-302690474-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:41:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1bc19273fa047e7bec957c05a6f0e4a',uuid=ffd43df5-7473-4cbf-aac1-52711f08e730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converting VIF {"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00d12234-ef, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65237218-14ae-4730-9243-b7fa7ed6962f) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:33 user nova-compute[74441]: INFO os_vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef')
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:33 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:41:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] volume_snapshot_create: create_info: {'snapshot_id': 'b88566b4-1e27-4707-a965-2dc19e94b624', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74441) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] snap xml: <domainsnapshot>
Nov 09 00:41:33 user nova-compute[74441]:   <disks>
Nov 09 00:41:33 user nova-compute[74441]:     <disk name="/dev/sdc" snapshot="external" type="file">
Nov 09 00:41:33 user nova-compute[74441]:       <source file="/dev/new_file"/>
Nov 09 00:41:33 user nova-compute[74441]:     </disk>
Nov 09 00:41:33 user nova-compute[74441]:     <disk name="vda" snapshot="no"/>
Nov 09 00:41:33 user nova-compute[74441]:   </disks>
Nov 09 00:41:33 user nova-compute[74441]: </domainsnapshot>
Nov 09 00:41:33 user nova-compute[74441]:  {{(pid=74441) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] Lazy-loading 'system_metadata' on Instance uuid 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Traceback (most recent call last):
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     rv = execute(f, *args, **kwargs)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     six.reraise(c, e, tb)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     raise value
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     rv = meth(*args, **kwargs)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] 
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Traceback (most recent call last):
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     self._volume_snapshot_create(context, instance, guest,
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     rv = execute(f, *args, **kwargs)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     six.reraise(c, e, tb)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     raise value
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     rv = meth(*args, **kwargs)
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] 
Nov 09 00:41:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-b7a481cd-1646-418d-8bfa-5f1a72c4cbe4 tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] volume_snapshot_delete: delete_info: {'volume_id': '51e7a449-5670-4a48-b4e8-3e5c750453db'} {{(pid=74441) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [None req-b7a481cd-1646-418d-8bfa-5f1a72c4cbe4 tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Traceback (most recent call last):
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220]     if delete_info['type'] != 'qcow2':
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] KeyError: 'type'
Nov 09 00:41:33 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] 
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26235383933353063', 'path': '/dev/sde'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235383933353063', 'path': '/dev/sde'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.838s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fc712-f2da-41a9-b51d-86443ad4c985]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:41:34 user nova-compute[74441]: No targets found.
Nov 09 00:41:34 user nova-compute[74441]: iSNS:
Nov 09 00:41:34 user nova-compute[74441]: No targets found.
Nov 09 00:41:34 user nova-compute[74441]: STATIC:
Nov 09 00:41:34 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b
Nov 09 00:41:34 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:34 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:34 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:41:34 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:34 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:34 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db
Nov 09 00:41:34 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:34 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:34 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287
Nov 09 00:41:34 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:34 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:34 user nova-compute[74441]: FIRMWARE:
Nov 09 00:41:34 user nova-compute[74441]: No targets found.
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:41:34 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:41:34 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMUvFQnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:34 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c00fb-9765-468c-a978-6ac642694eea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa85df-863a-4c67-b4c1-a074fc01e13f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c5ca320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c0fc1b-dec9-4036-837a-3c2c409bb49a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d09252-e755-419b-a274-2bff5e7ba10f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1496b43e-3180-40f9-aa20-61213ca9af8d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412a1d9-7ac7-40e5-9675-9257a56e17cb]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3febee8b-ab3e-4649-bbf0-9aa107037e21]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22cd71-88f7-43fd-b00d-3b956b9a4683]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]
Nov 09 00:41:34 user nova-compute[74441]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52118c40-f83f-4e03-a5e4-35da0f124664]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== disconnect_volume: return (1161ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:41:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Deleting instance files /opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730_del
Nov 09 00:41:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Deletion of /opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730_del complete
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.298s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:34 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:34 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7184319-ddcb-4725-aba5-8edd1a8bedf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:41:34 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[925d5ac4-d458-4d9f-8f52-ff05bb67d187]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255] added
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2501de8-b2cf-44d6-9609-c0d4b8acaac7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f553a4-02d5-441e-865c-113ba1cfaf31]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMUvFQnN {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aMUvFQnN" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e018dae8-3df7-4caf-80d6-e0c4d3f7fa37]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aMUvFQnN'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbf627-fcb4-4c7e-9087-426fc94c24be]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e686d3b-f1ef-4933-aae6-a565f0b6ece1]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849906c-0060-4e1a-9a34-0757d3c4c845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260]
Nov 09 00:41:34 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2defd7-b155-43f8-9000-d2506880ea75]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLVGSYJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:34 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f03e2f6-8f8d-460f-a300-1b12b7c32e79]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:34 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-ede2e569-cb6d-47d2-9fd3-113281cf4ef1 req-790199f6-dfea-4652-b8b7-7093204a584d service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ede2e569-cb6d-47d2-9fd3-113281cf4ef1 req-790199f6-dfea-4652-b8b7-7093204a584d service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ede2e569-cb6d-47d2-9fd3-113281cf4ef1 req-790199f6-dfea-4652-b8b7-7093204a584d service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ede2e569-cb6d-47d2-9fd3-113281cf4ef1 req-790199f6-dfea-4652-b8b7-7093204a584d service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-ede2e569-cb6d-47d2-9fd3-113281cf4ef1 req-790199f6-dfea-4652-b8b7-7093204a584d service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:34 user nova-compute[74441]: WARNING nova.compute.manager [req-ede2e569-cb6d-47d2-9fd3-113281cf4ef1 req-790199f6-dfea-4652-b8b7-7093204a584d service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state rebuilding.
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79614fb-9e42-4d03-91f0-b6478435d828]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMUvFQnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zGNmEVSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:34 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b88566b4-1e27-4707-a965-2dc19e94b624 could not be found.
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise value
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b88566b4-1e27-4707-a965-2dc19e94b624 could not be found. (HTTP 404) (Request-ID: req-1e5a96ba-9e0a-48ac-a4fd-f0206b5e5840)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b88566b4-1e27-4707-a965-2dc19e94b624 could not be found.
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server [None req-2e7fc9c3-ed06-4efd-9a62-abc3be32207d tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise value
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver [None req-b7a481cd-1646-418d-8bfa-5f1a72c4cbe4 tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ad61a00a-9d58-4435-b69a-0c43443c5003)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 09 00:41:35 user nova-compute[74441]: ERROR nova.virt.libvirt.driver 
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server [None req-b7a481cd-1646-418d-8bfa-5f1a72c4cbe4 tempest-VolumesAssistedSnapshotsTest-577255985 tempest-VolumesAssistedSnapshotsTest-577255985-project] Exception during message handling: KeyError: 'type'
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 09 00:41:35 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:41:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ffd43df5-7473-4cbf-aac1-52711f08e730 could not be found.
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:35 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:35 user nova-compute[74441]: INFO nova.compute.manager [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Detaching volume 51e7a449-5670-4a48-b4e8-3e5c750453db
Nov 09 00:41:35 user nova-compute[74441]: INFO nova.virt.block_device [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Attempting to driver detach volume 51e7a449-5670-4a48-b4e8-3e5c750453db from mountpoint /dev/vdb
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Attempting to detach device vdb from instance 7e394947-6c4c-4724-a566-ea34b44dd220 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] detach device xml: <disk type="block" device="disk">
Nov 09 00:41:35 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:35 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:41:35 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:   <serial>51e7a449-5670-4a48-b4e8-3e5c750453db</serial>
Nov 09 00:41:35 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:41:35 user nova-compute[74441]: </disk>
Nov 09 00:41:35 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:41:35 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Successfully detached device vdb from instance 7e394947-6c4c-4724-a566-ea34b44dd220 from the persistent domain config.
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e394947-6c4c-4724-a566-ea34b44dd220 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] detach device xml: <disk type="block" device="disk">
Nov 09 00:41:35 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:35 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:41:35 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:   <serial>51e7a449-5670-4a48-b4e8-3e5c750453db</serial>
Nov 09 00:41:35 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:41:35 user nova-compute[74441]: </disk>
Nov 09 00:41:35 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== connect_volume: return (1648ms) {'type': 'block', 'scsi_wwn': '26339393636396130', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339393636396130', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.040s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:35 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:35 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de3dfa4-23fc-4ac5-b066-b99bb0552b24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:41:35 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.objects.instance [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e7a69cc-14e9-4a6f-b736-e74de84f8220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[94029a11-67e5-4970-a0f4-a2add78e660c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50] added
Nov 09 00:41:35 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:41:35 user nova-compute[74441]:   <uuid>6e7a69cc-14e9-4a6f-b736-e74de84f8220</uuid>
Nov 09 00:41:35 user nova-compute[74441]:   <name>instance-0000000a</name>
Nov 09 00:41:35 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:41:35 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:41:35 user nova-compute[74441]:   <metadata>
Nov 09 00:41:35 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:41:35 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:41:35 user nova-compute[74441]:       <nova:name>tempest-device-tagging-server-1669128512</nova:name>
Nov 09 00:41:35 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:41:31</nova:creationTime>
Nov 09 00:41:35 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:41:35 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:41:35 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:41:35 user nova-compute[74441]:       <nova:owner>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:user uuid="26804e57dd3147418fb8986373a4563f">tempest-TaggedBootDevicesTest-1058018725-project-member</nova:user>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:project uuid="789f4722b46740f5909b90360503d651">tempest-TaggedBootDevicesTest-1058018725</nova:project>
Nov 09 00:41:35 user nova-compute[74441]:       </nova:owner>
Nov 09 00:41:35 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:41:35 user nova-compute[74441]:       <nova:ports>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="d0ba3d80-8917-462f-991c-c2d0cc3cd435">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="b68cc496-94c2-4b1e-8948-ae38830f1f31">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="acf304c2-5b24-48f8-bd04-50e61e1ab05e">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.70" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="b2c21445-4dc4-45a4-80a0-20c5377f3ab9">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="c5c6a59c-bc5e-40ea-9d14-b1422baa62f8">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="3fa7df24-0caa-4bc8-9a42-d3ae43cf157a">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:         <nova:port uuid="8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f">
Nov 09 00:41:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 09 00:41:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:41:35 user nova-compute[74441]:       </nova:ports>
Nov 09 00:41:35 user nova-compute[74441]:     </nova:instance>
Nov 09 00:41:35 user nova-compute[74441]:   </metadata>
Nov 09 00:41:35 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:41:35 user nova-compute[74441]:     <system>
Nov 09 00:41:35 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:41:35 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:41:35 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:41:35 user nova-compute[74441]:       <entry name="serial">6e7a69cc-14e9-4a6f-b736-e74de84f8220</entry>
Nov 09 00:41:35 user nova-compute[74441]:       <entry name="uuid">6e7a69cc-14e9-4a6f-b736-e74de84f8220</entry>
Nov 09 00:41:35 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:41:35 user nova-compute[74441]:     </system>
Nov 09 00:41:35 user nova-compute[74441]:   </sysinfo>
Nov 09 00:41:35 user nova-compute[74441]:   <os>
Nov 09 00:41:35 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:41:35 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:41:35 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:41:35 user nova-compute[74441]:   </os>
Nov 09 00:41:35 user nova-compute[74441]:   <features>
Nov 09 00:41:35 user nova-compute[74441]:     <acpi/>
Nov 09 00:41:35 user nova-compute[74441]:     <apic/>
Nov 09 00:41:35 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:41:35 user nova-compute[74441]:   </features>
Nov 09 00:41:35 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:41:35 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:41:35 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:41:35 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:41:35 user nova-compute[74441]:   </clock>
Nov 09 00:41:35 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:41:35 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:41:35 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:41:35 user nova-compute[74441]:   </cpu>
Nov 09 00:41:35 user nova-compute[74441]:   <devices>
Nov 09 00:41:35 user nova-compute[74441]:     <disk type="file" device="cdrom">
Nov 09 00:41:35 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 00:41:35 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220/disk.config"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="hda" bus="ide"/>
Nov 09 00:41:35 user nova-compute[74441]:     </disk>
Nov 09 00:41:35 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:41:35 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:35 user nova-compute[74441]:       <source dev="/dev/sdd"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <serial>52df89ea-53bd-43d4-81d7-79cebfc2899b</serial>
Nov 09 00:41:35 user nova-compute[74441]:     </disk>
Nov 09 00:41:35 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:41:35 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:35 user nova-compute[74441]:       <source dev="/dev/sde"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <serial>873e0202-35eb-4455-9a20-cf1f26aff8f6</serial>
Nov 09 00:41:35 user nova-compute[74441]:     </disk>
Nov 09 00:41:35 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:41:35 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:35 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="vdc" bus="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <serial>60873b71-53b8-4337-b171-07c6cae1a255</serial>
Nov 09 00:41:35 user nova-compute[74441]:     </disk>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:99:0c:fa"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tapd0ba3d80-89"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:c6:c0:db"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tapb68cc496-94"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:93:63:dd"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tapacf304c2-5b"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:d7:5b:a2"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tapb2c21445-4d"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:14:40:45"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tapc5c6a59c-bc"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:b0:f8:70"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tap3fa7df24-0c"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:41:35 user nova-compute[74441]:       <mac address="fa:16:3e:5a:2c:e7"/>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:41:35 user nova-compute[74441]:       <target dev="tap8b30ccb7-0d"/>
Nov 09 00:41:35 user nova-compute[74441]:     </interface>
Nov 09 00:41:35 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:41:35 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220/console.log" append="off"/>
Nov 09 00:41:35 user nova-compute[74441]:     </serial>
Nov 09 00:41:35 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:41:35 user nova-compute[74441]:     <video>
Nov 09 00:41:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:41:35 user nova-compute[74441]:     </video>
Nov 09 00:41:35 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:41:35 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:41:35 user nova-compute[74441]:     </rng>
Nov 09 00:41:35 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:41:35 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:41:35 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:41:35 user nova-compute[74441]:     </memballoon>
Nov 09 00:41:35 user nova-compute[74441]:   </devices>
Nov 09 00:41:35 user nova-compute[74441]: </domain>
Nov 09 00:41:35 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ee50c-5f58-4aad-b6d2-d48cd3654f9a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f13a3ad-6eb0-51d3-a116-44d1cabcd5ec', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ba3d80-89, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ba3d80-89, col_values=(('qos', UUID('dccd4439-b703-4fc6-9828-b769629314d4')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ba3d80-89, col_values=(('external_ids', {'iface-id': 'd0ba3d80-8917-462f-991c-c2d0cc3cd435', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:0c:fa', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[287612f3-d064-4ffb-8a8c-d514f781a90f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLVGSYJw {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a20117a-672b-583b-b49b-9ece83b26230', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLVGSYJw" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[49435f7e-c763-4e25-afd7-358bef4284a4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLVGSYJw'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb68cc496-94, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb68cc496-94, col_values=(('qos', UUID('58df9c43-680f-42d6-8157-508f693e13e0')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb68cc496-94, col_values=(('external_ids', {'iface-id': 'b68cc496-94c2-4b1e-8948-ae38830f1f31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:c0:db', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a2768-96fc-4e0e-9c41-4c61339bc57b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c5a3a10-d24a-5cc8-9090-83ea4ceeea10', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77f18b-a35f-4fe7-89c5-1824e2f63631]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacf304c2-5b, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacf304c2-5b, col_values=(('qos', UUID('058a93d5-20bf-466b-897e-52f2b6dbef8f')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacf304c2-5b, col_values=(('external_ids', {'iface-id': 'acf304c2-5b24-48f8-bd04-50e61e1ab05e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:63:dd', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51537e6e-6080-5533-a11c-ca31df24897b', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d71b19-f02e-427f-b0fb-77e7e4ad0761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260]
Nov 09 00:41:36 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:36 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2c21445-4d, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2c21445-4d, col_values=(('qos', UUID('e903da20-eabf-4152-8306-0fb228ee9e61')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2c21445-4d, col_values=(('external_ids', {'iface-id': 'b2c21445-4dc4-45a4-80a0-20c5377f3ab9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:5b:a2', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3eb93b-9578-43ad-ae30-9e1dcece353f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c874c06f-b248-4d93-8e02-8d42a7ed633f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:36 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca56eb7-64b2-4716-9a35-005051f00453]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLVGSYJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a1eb1c2-f323-5df3-b9f0-715f9b23f267', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5c6a59c-bc, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5c6a59c-bc, col_values=(('qos', UUID('80ed9943-3c19-4e02-818e-112d23f8ae2e')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5c6a59c-bc, col_values=(('external_ids', {'iface-id': 'c5c6a59c-bc5e-40ea-9d14-b1422baa62f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:40:45', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e625daf8-ce3c-5d54-ad01-4ed2ba22c2ce', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fa7df24-0c, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fa7df24-0c, col_values=(('qos', UUID('782ecca4-68d9-46b0-aab8-8c9ac43bc58a')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fa7df24-0c, col_values=(('external_ids', {'iface-id': '3fa7df24-0caa-4bc8-9a42-d3ae43cf157a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:f8:70', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a655ce68-a038-537a-a364-90b2b72602ca', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b30ccb7-0d, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b30ccb7-0d, col_values=(('qos', UUID('dd808ddf-580b-43fd-9dfe-96f662b9db77')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b30ccb7-0d, col_values=(('external_ids', {'iface-id': '8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:2c:e7', 'vm-uuid': '6e7a69cc-14e9-4a6f-b736-e74de84f8220'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:36 user nova-compute[74441]: INFO os_vif [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d')
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] No BDM found with device name hda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] No VIF found with MAC fa:16:3e:99:0c:fa, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:41:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] No VIF found with MAC fa:16:3e:14:40:45, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:41:36 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Using config drive
Nov 09 00:41:36 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Creating config drive at /opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220/disk.config
Nov 09 00:41:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5w1qj8hs {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5w1qj8hs" returned: 0 in 0.051s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] <== connect_volume: return (2483ms) {'type': 'block', 'scsi_wwn': '26539646238363863', 'path': '/dev/sdf'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539646238363863', 'path': '/dev/sdf'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.400s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:37 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:37 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'flavor' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103627a-be75-44da-94f9-e862e2b843f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:41:37 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d41a538-38e2-439b-a00b-44399649cf9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:41:37 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:37 user nova-compute[74441]:   <source dev="/dev/sdf"/>
Nov 09 00:41:37 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:37 user nova-compute[74441]:   <serial>e363087c-4249-4343-ac83-0421d5e01f50</serial>
Nov 09 00:41:37 user nova-compute[74441]: </disk>
Nov 09 00:41:37 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4] added
Nov 09 00:41:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ed3e0-681a-460d-a69b-3ffcdc3f2979]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220116e-0998-4af7-8d05-ead4d6e344de]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zGNmEVSX {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zGNmEVSX" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6564bb39-1b8c-4ff8-9aae-8c9afae0c3b6]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zGNmEVSX'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13905608-1374-4a65-9d2d-10bc7740d035]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3444f1f7-519c-48c2-9e25-95bee3d51a53]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0825c-03c6-4844-ba19-a5f1702c9051]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260]
Nov 09 00:41:37 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78211c80-fba6-4eef-8d88-fec3c83ab45b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[852be2e1-23dc-4310-8d6e-feeb92f1511f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:41:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c17a28-e454-4478-bfb7-3cab2331c395]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:41:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zGNmEVSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No BDM found with device name hda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] No VIF found with MAC fa:16:3e:d3:4b:2d, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3804423e-937c-4b8f-ace6-be736d91d5bd tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 80.337s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] <== connect_volume: return (3770ms) {'type': 'block', 'scsi_wwn': '23435646337366163', 'path': '/dev/sdg'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435646337366163', 'path': '/dev/sdg'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.378s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lazy-loading 'flavor' on Instance uuid 431c09e0-3913-46e9-8050-c5c6ac81be71 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7505564-527a-4e63-b2e9-443dabf4940a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:41:38 user nova-compute[74441]: No targets found.
Nov 09 00:41:38 user nova-compute[74441]: iSNS:
Nov 09 00:41:38 user nova-compute[74441]: No targets found.
Nov 09 00:41:38 user nova-compute[74441]: STATIC:
Nov 09 00:41:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50
Nov 09 00:41:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b
Nov 09 00:41:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:41:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:41:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db
Nov 09 00:41:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4
Nov 09 00:41:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:38 user nova-compute[74441]: FIRMWARE:
Nov 09 00:41:38 user nova-compute[74441]: No targets found.
Nov 09 00:41:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:41:38 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:41:38 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:41:38 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:38 user nova-compute[74441]:   <source dev="/dev/sdg"/>
Nov 09 00:41:38 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:38 user nova-compute[74441]:   <serial>bedb68b7-f430-4ab4-8aff-45e4278340c4</serial>
Nov 09 00:41:38 user nova-compute[74441]: </disk>
Nov 09 00:41:38 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e03a7-9718-426d-b707-1ec045b4286d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0519d7b7-8c15-4699-8e50-bc7282fba832]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:41:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c4d3520>, {}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Disconnecting from: [] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== disconnect_volume: return (3473ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:41:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-1ec1ec03-2973-4cf4-9d84-0d6f3c922139 req-030b1caa-c5cc-40e4-8319-a97709bd6cec service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1ec1ec03-2973-4cf4-9d84-0d6f3c922139 req-030b1caa-c5cc-40e4-8319-a97709bd6cec service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1ec1ec03-2973-4cf4-9d84-0d6f3c922139 req-030b1caa-c5cc-40e4-8319-a97709bd6cec service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1ec1ec03-2973-4cf4-9d84-0d6f3c922139 req-030b1caa-c5cc-40e4-8319-a97709bd6cec service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-1ec1ec03-2973-4cf4-9d84-0d6f3c922139 req-030b1caa-c5cc-40e4-8319-a97709bd6cec service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:39 user nova-compute[74441]: WARNING nova.compute.manager [req-1ec1ec03-2973-4cf4-9d84-0d6f3c922139 req-030b1caa-c5cc-40e4-8319-a97709bd6cec service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 for instance with vm_state building and task_state spawning.
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] No VIF found with MAC fa:16:3e:b6:1a:1d, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dd68514f-2fb4-48d4-b766-aca64df43454 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.835s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:39 user nova-compute[74441]: INFO nova.compute.manager [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Detaching volume e363087c-4249-4343-ac83-0421d5e01f50
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:39 user nova-compute[74441]: INFO nova.virt.block_device [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Attempting to driver detach volume e363087c-4249-4343-ac83-0421d5e01f50 from mountpoint /dev/vdb
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Attempting to detach device vdb from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:41:39 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:39 user nova-compute[74441]:   <source dev="/dev/sdf"/>
Nov 09 00:41:39 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:39 user nova-compute[74441]:   <serial>e363087c-4249-4343-ac83-0421d5e01f50</serial>
Nov 09 00:41:39 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 00:41:39 user nova-compute[74441]: </disk>
Nov 09 00:41:39 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:41:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully detached device vdb from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the persistent domain config.
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:41:39 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:39 user nova-compute[74441]:   <source dev="/dev/sdf"/>
Nov 09 00:41:39 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:39 user nova-compute[74441]:   <serial>e363087c-4249-4343-ac83-0421d5e01f50</serial>
Nov 09 00:41:39 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 00:41:39 user nova-compute[74441]: </disk>
Nov 09 00:41:39 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:41:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-e4637241-d72c-47d3-a884-c4b938a38442 req-67ed2231-fb1b-4721-bbb4-d683c3fc6288 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e4637241-d72c-47d3-a884-c4b938a38442 req-67ed2231-fb1b-4721-bbb4-d683c3fc6288 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e4637241-d72c-47d3-a884-c4b938a38442 req-67ed2231-fb1b-4721-bbb4-d683c3fc6288 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e4637241-d72c-47d3-a884-c4b938a38442 req-67ed2231-fb1b-4721-bbb4-d683c3fc6288 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-e4637241-d72c-47d3-a884-c4b938a38442 req-67ed2231-fb1b-4721-bbb4-d683c3fc6288 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:40 user nova-compute[74441]: WARNING nova.compute.manager [req-e4637241-d72c-47d3-a884-c4b938a38442 req-67ed2231-fb1b-4721-bbb4-d683c3fc6288 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e for instance with vm_state building and task_state spawning.
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-16957e47-1d56-4bb3-8170-8d41145b5f7c req-2356c327-c84c-4845-8b6a-f22de1128f57 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16957e47-1d56-4bb3-8170-8d41145b5f7c req-2356c327-c84c-4845-8b6a-f22de1128f57 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16957e47-1d56-4bb3-8170-8d41145b5f7c req-2356c327-c84c-4845-8b6a-f22de1128f57 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16957e47-1d56-4bb3-8170-8d41145b5f7c req-2356c327-c84c-4845-8b6a-f22de1128f57 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-16957e47-1d56-4bb3-8170-8d41145b5f7c req-2356c327-c84c-4845-8b6a-f22de1128f57 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:40 user nova-compute[74441]: WARNING nova.compute.manager [req-16957e47-1d56-4bb3-8170-8d41145b5f7c req-2356c327-c84c-4845-8b6a-f22de1128f57 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 for instance with vm_state building and task_state spawning.
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:41 user nova-compute[74441]: WARNING nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 for instance with vm_state building and task_state spawning.
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:41 user nova-compute[74441]: WARNING nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 for instance with vm_state building and task_state spawning.
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:41 user nova-compute[74441]: WARNING nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 for instance with vm_state building and task_state spawning.
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:41 user nova-compute[74441]: WARNING nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 for instance with vm_state building and task_state spawning.
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:41 user nova-compute[74441]: WARNING nova.compute.manager [req-40da83ce-92f4-42fe-b138-71e3993feaf3 req-de99a331-63c2-4af3-85de-d5ad9f2363c8 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 for instance with vm_state building and task_state spawning.
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:42 user nova-compute[74441]: WARNING nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e for instance with vm_state building and task_state spawning.
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:42 user nova-compute[74441]: WARNING nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a for instance with vm_state building and task_state spawning.
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:42 user nova-compute[74441]: WARNING nova.compute.manager [req-e3f1b716-1d38-490f-bc79-513f40271cfd req-af24fd02-ecc3-4912-ad5d-08ee7b6e9369 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a for instance with vm_state building and task_state spawning.
Nov 09 00:41:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-5599d02e-d49c-4818-b491-3a17babd64df req-72439a27-3cf3-4764-bc24-bc902a13c33b service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5599d02e-d49c-4818-b491-3a17babd64df req-72439a27-3cf3-4764-bc24-bc902a13c33b service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5599d02e-d49c-4818-b491-3a17babd64df req-72439a27-3cf3-4764-bc24-bc902a13c33b service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5599d02e-d49c-4818-b491-3a17babd64df req-72439a27-3cf3-4764-bc24-bc902a13c33b service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-5599d02e-d49c-4818-b491-3a17babd64df req-72439a27-3cf3-4764-bc24-bc902a13c33b service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:42 user nova-compute[74441]: WARNING nova.compute.manager [req-5599d02e-d49c-4818-b491-3a17babd64df req-72439a27-3cf3-4764-bc24-bc902a13c33b service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 for instance with vm_state building and task_state spawning.
Nov 09 00:41:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:42 user nova-compute[74441]: INFO nova.compute.manager [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Detaching volume bedb68b7-f430-4ab4-8aff-45e4278340c4
Nov 09 00:41:42 user nova-compute[74441]: INFO nova.virt.block_device [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Attempting to driver detach volume bedb68b7-f430-4ab4-8aff-45e4278340c4 from mountpoint /dev/vdb
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Attempting to detach device vdb from instance 431c09e0-3913-46e9-8050-c5c6ac81be71 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:41:42 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:42 user nova-compute[74441]:   <source dev="/dev/sdg"/>
Nov 09 00:41:42 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:42 user nova-compute[74441]:   <serial>bedb68b7-f430-4ab4-8aff-45e4278340c4</serial>
Nov 09 00:41:42 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:41:42 user nova-compute[74441]: </disk>
Nov 09 00:41:42 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:41:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Successfully detached device vdb from instance 431c09e0-3913-46e9-8050-c5c6ac81be71 from the persistent domain config.
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 431c09e0-3913-46e9-8050-c5c6ac81be71 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:41:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:41:42 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:41:42 user nova-compute[74441]:   <source dev="/dev/sdg"/>
Nov 09 00:41:42 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:41:42 user nova-compute[74441]:   <serial>bedb68b7-f430-4ab4-8aff-45e4278340c4</serial>
Nov 09 00:41:42 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:41:42 user nova-compute[74441]: </disk>
Nov 09 00:41:42 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:43 user nova-compute[74441]: WARNING nova.compute.manager [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f for instance with vm_state building and task_state spawning.
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:41:43 user nova-compute[74441]: WARNING nova.compute.manager [req-c65bf172-30fc-4e30-9de9-244c6a26d65e req-cbe2a81d-b308-4854-8c50-d3f74c857b25 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f for instance with vm_state building and task_state spawning.
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 431c09e0-3913-46e9-8050-c5c6ac81be71 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:41:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance spawned successfully.
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:41:43 user nova-compute[74441]: INFO nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Took 12.53 seconds to spawn the instance on the hypervisor.
Nov 09 00:41:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:41:44 user nova-compute[74441]: INFO nova.compute.manager [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Took 94.35 seconds to build instance.
Nov 09 00:41:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-441d6787-0970-4b24-a2f4-96638e4efa1d tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 94.488s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:41:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:41:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:41:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:41:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8130MB free_disk=25.391803741455078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Preparing to wait for external event volume-reimaged-8540ef16-d3c0-427d-a8df-7e7eac6be287 {{(pid=74441) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 265471cf-50b2-4759-a485-fa5e2a4e50a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance f4bd46e4-44cb-4b47-9781-4adece881c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance a35832ac-1910-4496-b14e-fcb99b973e41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7e394947-6c4c-4724-a566-ea34b44dd220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 431c09e0-3913-46e9-8050-c5c6ac81be71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ffd43df5-7473-4cbf-aac1-52711f08e730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6e7a69cc-14e9-4a6f-b736-e74de84f8220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:41:51 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:41:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:41:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:41:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:41:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:56 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e394947-6c4c-4724-a566-ea34b44dd220 is timed out.
Nov 09 00:41:56 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Successfully detached device vdb from instance 7e394947-6c4c-4724-a566-ea34b44dd220 from the live domain config.
Nov 09 00:41:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkIFxQYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:56 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c6a787-b30a-435c-b87a-fca41e640ef6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:41:56 user nova-compute[74441]: No targets found.
Nov 09 00:41:56 user nova-compute[74441]: iSNS:
Nov 09 00:41:56 user nova-compute[74441]: No targets found.
Nov 09 00:41:56 user nova-compute[74441]: STATIC:
Nov 09 00:41:56 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50
Nov 09 00:41:56 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:56 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:56 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b
Nov 09 00:41:56 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:56 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:56 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:41:56 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:56 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:56 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:41:56 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:56 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:56 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db
Nov 09 00:41:56 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:56 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:56 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4
Nov 09 00:41:56 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:41:56 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:41:56 user nova-compute[74441]: FIRMWARE:
Nov 09 00:41:56 user nova-compute[74441]: No targets found.
Nov 09 00:41:56 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:41:56 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:41:56 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[050753d8-c05a-4fe6-8b82-8279b16aa30d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f429168e-6cd4-4985-883c-fdc52949b5b6]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:41:56 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f01440fa710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d071ca1-f5c0-43b6-a1b7-4a91ca2f27cd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b967153-1a3a-4408-a2b0-2b942a38ac1c]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[678219ab-2a88-445c-8a31-309205feca49]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60c6c4-4a2f-4ed3-89c9-c6f85dfb33ce]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28273e-53e1-4de4-9371-6baead79ce30]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea29871-04ba-483b-808a-80da98e70ca5]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260]
Nov 09 00:41:56 user nova-compute[74441]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db, portal: 172.16.0.220,3260] successful.
Nov 09 00:41:56 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51e7a449-5670-4a48-b4e8-3e5c750453db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdc88a7-e658-44a7-a12c-c4c7bf2bdeb7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] <== disconnect_volume: return (442ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:41:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:41:56 user nova-compute[74441]: INFO nova.compute.manager [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Unshelving
Nov 09 00:41:56 user nova-compute[74441]: INFO nova.virt.block_device [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Booting with volume ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 at /dev/vdc
Nov 09 00:41:57 user nova-compute[74441]: DEBUG os_brick.utils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe896b2c-1439-4633-9c1e-2af21b38fce5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda4a58-e8ad-4732-9bae-5188ff8b3d52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.036s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e675e9c-87a7-4a1d-974a-922efde76ee9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0f61f7-09b7-45cd-9fea-bd0299180be5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:41:57 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:41:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8571528-f879-4f17-a219-4b99dd6794e4]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG os_brick.utils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating existing volume attachment record: 3b242354-0b5c-4eb7-b2b2-9c749fa6ecbc {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:41:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:00 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4bd46e4-44cb-4b47-9781-4adece881c74 is timed out.
Nov 09 00:42:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully detached device vdb from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the live domain config.
Nov 09 00:42:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLVGSYJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:00 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f67584-d979-48f3-b19b-d76d3e489a24]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:42:00 user nova-compute[74441]: No targets found.
Nov 09 00:42:00 user nova-compute[74441]: iSNS:
Nov 09 00:42:00 user nova-compute[74441]: No targets found.
Nov 09 00:42:00 user nova-compute[74441]: STATIC:
Nov 09 00:42:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50
Nov 09 00:42:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b
Nov 09 00:42:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:42:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:42:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4
Nov 09 00:42:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:00 user nova-compute[74441]: FIRMWARE:
Nov 09 00:42:00 user nova-compute[74441]: No targets found.
Nov 09 00:42:00 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:42:00 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:42:00 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[68909af6-7921-4cb8-8376-3c0b62c5d7e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6916ac0-de42-489a-97e0-1626f7e73361]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:42:00 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c53a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50'): ({'sdf'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Removing single pathed devices sdf {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d473467d-78ba-48ca-b456-1c29c76743f9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6464d6-8ab5-48b3-88cb-c600a9d68173]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Flushing IO for device /dev/sdf {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c603a3-2617-4c43-af96-aced6167618f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5289a27-956a-44b2-a4a4-7210fa6baf1e]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceefd5b1-263f-413c-92f9-37861fb085b5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c39a62-81f6-4e9a-8b22-c90180db3473]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260]
Nov 09 00:42:01 user nova-compute[74441]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e363087c-4249-4343-ac83-0421d5e01f50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d580c0-5c7b-47e9-9dbc-27178a7d1951]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] <== disconnect_volume: return (368ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:42:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:03 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 431c09e0-3913-46e9-8050-c5c6ac81be71 is timed out.
Nov 09 00:42:03 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Successfully detached device vdb from instance 431c09e0-3913-46e9-8050-c5c6ac81be71 from the live domain config.
Nov 09 00:42:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zGNmEVSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:03 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f1aad-d683-4468-9320-84dbbad386ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:42:03 user nova-compute[74441]: No targets found.
Nov 09 00:42:03 user nova-compute[74441]: iSNS:
Nov 09 00:42:03 user nova-compute[74441]: No targets found.
Nov 09 00:42:03 user nova-compute[74441]: STATIC:
Nov 09 00:42:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b
Nov 09 00:42:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:42:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:42:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4
Nov 09 00:42:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:03 user nova-compute[74441]: FIRMWARE:
Nov 09 00:42:03 user nova-compute[74441]: No targets found.
Nov 09 00:42:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:42:03 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:42:03 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1180fdab-051b-4036-a97b-8ff801e13286]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[301ece3e-ae5e-4db5-962e-ac52d8643288]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:03 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:03 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:03 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:42:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:03 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:03 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:03 user nova-compute[74441]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 (non-flash)
Nov 09 00:42:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c53b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4'): ({'sdg'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Removing single pathed devices sdg {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4d9c2-cb6b-4f47-a22d-93a375f49363]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62335c0e-c8fb-4c7d-9120-ec815174d04e]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Flushing IO for device /dev/sdg {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0baf59b-04b7-4181-8fa7-3107de001db9]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de262f-366d-40bb-ad43-ec5e0f59c000]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] SCSI volumes sdg have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd6049-5285-48e0-bb06-f6411518b12f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[560d049a-85d1-42ee-83fe-05752fe0985d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260]
Nov 09 00:42:03 user nova-compute[74441]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bedb68b7-f430-4ab4-8aff-45e4278340c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4014600-ab29-4085-889a-1ab56f7ef439]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] <== disconnect_volume: return (351ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:42:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:07 user nova-compute[74441]: DEBUG nova.objects.instance [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lazy-loading 'flavor' on Instance uuid 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03ce00d3-31ba-474e-af4d-48dd74512747 tempest-VolumesAssistedSnapshotsTest-1329507284 tempest-VolumesAssistedSnapshotsTest-1329507284-project-admin] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.032s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMpKmwzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:28 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:28 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:28 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0611133-0317-441d-99c1-56bef1203b2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:42:28 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbf63ab-632c-4046-ba14-96f205b19813]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98] added
Nov 09 00:42:28 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b126c3-fa7c-421b-96ca-9acb9761d0d0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c06240-fac6-46d8-a99e-cebbf8708d3e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMpKmwzJ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMpKmwzJ" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91268fba-f136-4bb9-acb8-823f5d9711ea]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMpKmwzJ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab2f8be-1967-4dca-8101-1a9bb08bac1d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01b03a-daeb-4e62-84cb-dada42cb0545]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637007b-3405-4e44-bbb1-f466ed4002f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260]
Nov 09 00:42:28 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:28 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8ac5e-1a47-49e4-aee6-4f75743b402e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5e125d-b9e2-46e8-a568-63c979736726]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:28 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbf8b88-ca27-4cf0-a5a6-b820e8588a5c]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:42:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMpKmwzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.objects.instance [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'pci_requests' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.objects.instance [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'numa_topology' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:42:29 user nova-compute[74441]: INFO nova.compute.claims [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Claim successful on node user
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lazy-loading 'flavor' on Instance uuid 431c09e0-3913-46e9-8050-c5c6ac81be71 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a4617bb9-63a1-42dc-8a9b-c5903181a582 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 46.623s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26364626337333038', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364626337333038', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'flavor' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:42:29 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:42:29 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:42:29 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:42:29 user nova-compute[74441]:   <serial>ce983810-1854-4cf1-8f5c-4ea7af02fd98</serial>
Nov 09 00:42:29 user nova-compute[74441]: </disk>
Nov 09 00:42:29 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:29 user nova-compute[74441]: INFO nova.network.neutron [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating port 958e30c3-1bcc-4902-8868-851d7f71c00e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:42:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No VIF found with MAC fa:16:3e:9a:b8:71, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:42:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e058d603-36b7-4420-96fd-19323d2ef477 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.930s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:30 user nova-compute[74441]: DEBUG nova.objects.instance [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'flavor' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-799dc46c-fd3a-4073-8f5f-af1d203f227e tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 50.679s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing instance network info cache due to event network-changed-958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] Acquiring lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "interface-f4bd46e4-44cb-4b47-9781-4adece881c74-2ab19211-0ca7-44bb-8e1e-4cbcafe02175" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "interface-f4bd46e4-44cb-4b47-9781-4adece881c74-2ab19211-0ca7-44bb-8e1e-4cbcafe02175" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'flavor' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface> {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface> {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Attempting to detach device tap2ab19211-0c from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] detach device xml: <interface type="ethernet">
Nov 09 00:42:31 user nova-compute[74441]:   <mac address="fa:16:3e:c6:c5:99"/>
Nov 09 00:42:31 user nova-compute[74441]:   <model type="virtio"/>
Nov 09 00:42:31 user nova-compute[74441]:   <mtu size="1442"/>
Nov 09 00:42:31 user nova-compute[74441]:   <target dev="tap2ab19211-0c"/>
Nov 09 00:42:31 user nova-compute[74441]: </interface>
Nov 09 00:42:31 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface> {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface>not found in domain: <domain type='kvm' id='4'>
Nov 09 00:42:31 user nova-compute[74441]:   <name>instance-00000004</name>
Nov 09 00:42:31 user nova-compute[74441]:   <uuid>f4bd46e4-44cb-4b47-9781-4adece881c74</uuid>
Nov 09 00:42:31 user nova-compute[74441]:   <metadata>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:31 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:42:31 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:42:31 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:40:16</nova:creationTime>
Nov 09 00:42:31 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:42:31 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:31 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:42:31 user nova-compute[74441]:   <nova:owner>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:42:31 user nova-compute[74441]:   </nova:owner>
Nov 09 00:42:31 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:42:31 user nova-compute[74441]:   <nova:ports>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:42:31 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:42:31 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:31 user nova-compute[74441]:     <nova:port uuid="2ab19211-0ca7-44bb-8e1e-4cbcafe02175">
Nov 09 00:42:31 user nova-compute[74441]:       <nova:ip type="fixed" address="10.10.10.128" ipVersion="4"/>
Nov 09 00:42:31 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:31 user nova-compute[74441]:   </nova:ports>
Nov 09 00:42:31 user nova-compute[74441]: </nova:instance>
Nov 09 00:42:31 user nova-compute[74441]:   </metadata>
Nov 09 00:42:31 user nova-compute[74441]:   <memory unit='KiB'>524288</memory>
Nov 09 00:42:31 user nova-compute[74441]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 00:42:31 user nova-compute[74441]:   <vcpu placement='static'>1</vcpu>
Nov 09 00:42:31 user nova-compute[74441]:   <resource>
Nov 09 00:42:31 user nova-compute[74441]:     <partition>/machine</partition>
Nov 09 00:42:31 user nova-compute[74441]:   </resource>
Nov 09 00:42:31 user nova-compute[74441]:   <sysinfo type='smbios'>
Nov 09 00:42:31 user nova-compute[74441]:     <system>
Nov 09 00:42:31 user nova-compute[74441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 00:42:31 user nova-compute[74441]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 00:42:31 user nova-compute[74441]:       <entry name='version'>0.0.0</entry>
Nov 09 00:42:31 user nova-compute[74441]:       <entry name='serial'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:31 user nova-compute[74441]:       <entry name='uuid'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:31 user nova-compute[74441]:       <entry name='family'>Virtual Machine</entry>
Nov 09 00:42:31 user nova-compute[74441]:     </system>
Nov 09 00:42:31 user nova-compute[74441]:   </sysinfo>
Nov 09 00:42:31 user nova-compute[74441]:   <os>
Nov 09 00:42:31 user nova-compute[74441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 00:42:31 user nova-compute[74441]:     <boot dev='hd'/>
Nov 09 00:42:31 user nova-compute[74441]:     <smbios mode='sysinfo'/>
Nov 09 00:42:31 user nova-compute[74441]:   </os>
Nov 09 00:42:31 user nova-compute[74441]:   <features>
Nov 09 00:42:31 user nova-compute[74441]:     <acpi/>
Nov 09 00:42:31 user nova-compute[74441]:     <apic/>
Nov 09 00:42:31 user nova-compute[74441]:     <vmcoreinfo state='on'/>
Nov 09 00:42:31 user nova-compute[74441]:   </features>
Nov 09 00:42:31 user nova-compute[74441]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 00:42:31 user nova-compute[74441]:     <model fallback='forbid'>Nehalem</model>
Nov 09 00:42:31 user nova-compute[74441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 00:42:31 user nova-compute[74441]:     <feature policy='require' name='vme'/>
Nov 09 00:42:31 user nova-compute[74441]:     <feature policy='require' name='x2apic'/>
Nov 09 00:42:31 user nova-compute[74441]:     <feature policy='require' name='hypervisor'/>
Nov 09 00:42:31 user nova-compute[74441]:   </cpu>
Nov 09 00:42:31 user nova-compute[74441]:   <clock offset='utc'>
Nov 09 00:42:31 user nova-compute[74441]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 00:42:31 user nova-compute[74441]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 00:42:31 user nova-compute[74441]:     <timer name='hpet' present='no'/>
Nov 09 00:42:31 user nova-compute[74441]:   </clock>
Nov 09 00:42:31 user nova-compute[74441]:   <on_poweroff>destroy</on_poweroff>
Nov 09 00:42:31 user nova-compute[74441]:   <on_reboot>restart</on_reboot>
Nov 09 00:42:31 user nova-compute[74441]:   <on_crash>destroy</on_crash>
Nov 09 00:42:31 user nova-compute[74441]:   <devices>
Nov 09 00:42:31 user nova-compute[74441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 00:42:31 user nova-compute[74441]:     <disk type='file' device='disk'>
Nov 09 00:42:31 user nova-compute[74441]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 00:42:31 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk' index='2'/>
Nov 09 00:42:31 user nova-compute[74441]:       <backingStore type='file' index='3'>
Nov 09 00:42:31 user nova-compute[74441]:         <format type='raw'/>
Nov 09 00:42:31 user nova-compute[74441]:         <source file='/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4'/>
Nov 09 00:42:31 user nova-compute[74441]:         <backingStore/>
Nov 09 00:42:31 user nova-compute[74441]:       </backingStore>
Nov 09 00:42:31 user nova-compute[74441]:       <target dev='vda' bus='virtio'/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='virtio-disk0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </disk>
Nov 09 00:42:31 user nova-compute[74441]:     <disk type='file' device='cdrom'>
Nov 09 00:42:31 user nova-compute[74441]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 00:42:31 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config' index='1'/>
Nov 09 00:42:31 user nova-compute[74441]:       <backingStore/>
Nov 09 00:42:31 user nova-compute[74441]:       <target dev='hda' bus='ide'/>
Nov 09 00:42:31 user nova-compute[74441]:       <readonly/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='ide0-0-0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </disk>
Nov 09 00:42:31 user nova-compute[74441]:     <controller type='usb' index='0' model='none'>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='usb'/>
Nov 09 00:42:31 user nova-compute[74441]:     </controller>
Nov 09 00:42:31 user nova-compute[74441]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='pci.0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </controller>
Nov 09 00:42:31 user nova-compute[74441]:     <controller type='ide' index='0'>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='ide'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 00:42:31 user nova-compute[74441]:     </controller>
Nov 09 00:42:31 user nova-compute[74441]:     <interface type='ethernet'>
Nov 09 00:42:31 user nova-compute[74441]:       <mac address='fa:16:3e:d3:4b:2d'/>
Nov 09 00:42:31 user nova-compute[74441]:       <target dev='tap791979c2-d1'/>
Nov 09 00:42:31 user nova-compute[74441]:       <model type='virtio'/>
Nov 09 00:42:31 user nova-compute[74441]:       <mtu size='1442'/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='net0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </interface>
Nov 09 00:42:31 user nova-compute[74441]:     <interface type='ethernet'>
Nov 09 00:42:31 user nova-compute[74441]:       <mac address='fa:16:3e:c6:c5:99'/>
Nov 09 00:42:31 user nova-compute[74441]:       <target dev='tap2ab19211-0c'/>
Nov 09 00:42:31 user nova-compute[74441]:       <model type='virtio'/>
Nov 09 00:42:31 user nova-compute[74441]:       <mtu size='1442'/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='net1'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </interface>
Nov 09 00:42:31 user nova-compute[74441]:     <serial type='pty'>
Nov 09 00:42:31 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:31 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:31 user nova-compute[74441]:       <target type='isa-serial' port='0'>
Nov 09 00:42:31 user nova-compute[74441]:         <model name='isa-serial'/>
Nov 09 00:42:31 user nova-compute[74441]:       </target>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </serial>
Nov 09 00:42:31 user nova-compute[74441]:     <console type='pty' tty='/dev/pts/3'>
Nov 09 00:42:31 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:31 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:31 user nova-compute[74441]:       <target type='serial' port='0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </console>
Nov 09 00:42:31 user nova-compute[74441]:     <input type='mouse' bus='ps2'>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='input0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </input>
Nov 09 00:42:31 user nova-compute[74441]:     <input type='keyboard' bus='ps2'>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='input1'/>
Nov 09 00:42:31 user nova-compute[74441]:     </input>
Nov 09 00:42:31 user nova-compute[74441]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 09 00:42:31 user nova-compute[74441]:       <listen type='address' address='0.0.0.0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </graphics>
Nov 09 00:42:31 user nova-compute[74441]:     <audio id='1' type='none'/>
Nov 09 00:42:31 user nova-compute[74441]:     <video>
Nov 09 00:42:31 user nova-compute[74441]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='video0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </video>
Nov 09 00:42:31 user nova-compute[74441]:     <memballoon model='virtio'>
Nov 09 00:42:31 user nova-compute[74441]:       <stats period='10'/>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='balloon0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </memballoon>
Nov 09 00:42:31 user nova-compute[74441]:     <rng model='virtio'>
Nov 09 00:42:31 user nova-compute[74441]:       <backend model='random'>/dev/urandom</backend>
Nov 09 00:42:31 user nova-compute[74441]:       <alias name='rng0'/>
Nov 09 00:42:31 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 00:42:31 user nova-compute[74441]:     </rng>
Nov 09 00:42:31 user nova-compute[74441]:   </devices>
Nov 09 00:42:31 user nova-compute[74441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 00:42:31 user nova-compute[74441]:     <label>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</label>
Nov 09 00:42:31 user nova-compute[74441]:     <imagelabel>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</imagelabel>
Nov 09 00:42:31 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:31 user nova-compute[74441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 00:42:31 user nova-compute[74441]:     <label>+64055:+108</label>
Nov 09 00:42:31 user nova-compute[74441]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 00:42:31 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:31 user nova-compute[74441]: </domain>
Nov 09 00:42:31 user nova-compute[74441]:  {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 00:42:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully detached device tap2ab19211-0c from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the persistent domain config.
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] (1/8): Attempting to detach device tap2ab19211-0c with device alias net1 from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] detach device xml: <interface type="ethernet">
Nov 09 00:42:31 user nova-compute[74441]:   <mac address="fa:16:3e:c6:c5:99"/>
Nov 09 00:42:31 user nova-compute[74441]:   <model type="virtio"/>
Nov 09 00:42:31 user nova-compute[74441]:   <mtu size="1442"/>
Nov 09 00:42:31 user nova-compute[74441]:   <target dev="tap2ab19211-0c"/>
Nov 09 00:42:31 user nova-compute[74441]: </interface>
Nov 09 00:42:31 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:42:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Creating image(s)
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'trusted_certs' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] Acquired lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Refreshing network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.objects.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<d717ddbc-6c16-4b0b-812a-6cb46b5314dc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "7b08c2ba132b05e6c108017936a22b4bf85a593b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "7b08c2ba132b05e6c108017936a22b4bf85a593b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Start waiting for the detach event from libvirt for device tap2ab19211-0c with device alias net1 for instance f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.virt.images [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] 2d94e410-7990-4d3d-9a75-e470aa954ae2 was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.part /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.part /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.converted" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.network.neutron [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updated VIF entry in instance network info cache for port 958e30c3-1bcc-4902-8868-851d7f71c00e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.network.neutron [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-unplugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-unplugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:33 user nova-compute[74441]: WARNING nova.compute.manager [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-unplugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 for instance with vm_state active and task_state None.
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:33 user nova-compute[74441]: WARNING nova.compute.manager [req-ff26456d-4899-47ad-80d4-48f79db47c36 req-3ceebe4c-9bc3-407c-8387-6c089316e4ac service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-plugged-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 for instance with vm_state active and task_state None.
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1496cfb8-7a5d-4204-a131-e654c262d04a req-510a587a-44bc-4d5f-8ff0-864b8baed4ec service nova] Releasing lock "refresh_cache-d717ddbc-6c16-4b0b-812a-6cb46b5314dc" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "7b08c2ba132b05e6c108017936a22b4bf85a593b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.737s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG nova.objects.instance [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'flavor' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "7b08c2ba132b05e6c108017936a22b4bf85a593b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "7b08c2ba132b05e6c108017936a22b4bf85a593b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:33 user nova-compute[74441]: INFO nova.compute.manager [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attaching volume bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 to /dev/vdc
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b,backing_fmt=raw /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG os_brick.utils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b,backing_fmt=raw /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk 1073741824" returned: 0 in 0.057s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "7b08c2ba132b05e6c108017936a22b4bf85a593b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161cb15-1e4e-456c-9347-c08f10de78fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a7451-5229-4351-b34f-f87794b2412c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c905db62-9d58-4acf-a57c-8b49d3f52531]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2d9838-f4d2-4b18-9042-6d64a5e89eb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:42:34 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8cb61a-a97f-4b75-bcd3-bc0494917695]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG os_brick.utils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updating existing volume attachment record: 92be7f99-f66a-4ce4-98cf-eb7cf496f6c9 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'migration_context' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG nova.objects.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<d717ddbc-6c16-4b0b-812a-6cb46b5314dc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:42:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Rebasing disk image.
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 -F raw /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 -F raw /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk" returned: 0 in 2.811s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Ensure instance console log exists: /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Start _get_guest_xml network_info=[{"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='96bd42f9517c1a82bc345ef9ad052a70',container_format='bare',created_at=2023-11-09T00:40:03Z,direct_url=<?>,disk_format='qcow2',id=2d94e410-7990-4d3d-9a75-e470aa954ae2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-88303642-shelved',owner='6f51b840472c4aeb8a0a5f2a5dfad975',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T00:40:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKlOgiMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd717ddbc-6c16-4b0b-812a-6cb46b5314dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba6803b0-0980-4c35-b7aa-3e0a516ddbc8', 'serial': 'ba6803b0-0980-4c35-b7aa-3e0a516ddbc8'}, 'attachment_id': '3b242354-0b5c-4eb7-b2b2-9c749fa6ecbc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:42:37 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:42:37 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='96bd42f9517c1a82bc345ef9ad052a70',container_format='bare',created_at=2023-11-09T00:40:03Z,direct_url=<?>,disk_format='qcow2',id=2d94e410-7990-4d3d-9a75-e470aa954ae2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-88303642-shelved',owner='6f51b840472c4aeb8a0a5f2a5dfad975',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T00:40:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.objects.instance [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'vcpu_model' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.objects.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<d717ddbc-6c16-4b0b-812a-6cb46b5314dc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKlOgiMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:37 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:37 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:37 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab9a7b-84d1-416a-b75a-32196eb3334a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:42:37 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a383811-1307-458c-b269-4836bebcba67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8] added
Nov 09 00:42:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e29e021-c1d3-4928-b3e5-598cd1c802ba]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6853d1e-ed29-43fd-af94-39c03caeee0c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKlOgiMA {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKlOgiMA" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8b31b-0846-48e8-8251-42a8c8b49758]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKlOgiMA'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25aa9b0-de0e-4e83-b695-715374485ec0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d38ddd-e9e0-4150-84a6-ce5817012d18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba0e0fc-72c2-4c50-8dbd-221d31f7f1ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260]
Nov 09 00:42:37 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21159a-c3a4-4bcc-8e87-dd3e756451aa]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b62dd-55c4-4529-83e2-d682eea7be40]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.055s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52965f1-f06a-4334-8a99-5b6833519b67]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:42:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKlOgiMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23030333266346135', 'path': '/dev/sdg'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030333266346135', 'path': '/dev/sdg'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-88303642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-88303642',id=2,image_ref='2d94e410-7990-4d3d-9a75-e470aa954ae2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-555090617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-xa6rl5bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member',shelved_at='2023-11-09T00:40:09.152551',shelved_host='user',shelved_image_id='2d94e410-7990-4d3d-9a75-e470aa954ae2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=d717ddbc-6c16-4b0b-812a-6cb46b5314dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'pci_devices' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.objects.base [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<d717ddbc-6c16-4b0b-812a-6cb46b5314dc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:42:38 user nova-compute[74441]:   <uuid>d717ddbc-6c16-4b0b-812a-6cb46b5314dc</uuid>
Nov 09 00:42:38 user nova-compute[74441]:   <name>instance-00000002</name>
Nov 09 00:42:38 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:42:38 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:42:38 user nova-compute[74441]:   <metadata>
Nov 09 00:42:38 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:38 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:42:38 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-88303642</nova:name>
Nov 09 00:42:38 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:42:37</nova:creationTime>
Nov 09 00:42:38 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:42:38 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:38 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:42:38 user nova-compute[74441]:       <nova:owner>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:user uuid="e8b687249f4d41d680915f2d30fc8dbd">tempest-AttachVolumeShelveTestJSON-1580389683-project-member</nova:user>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:project uuid="6f51b840472c4aeb8a0a5f2a5dfad975">tempest-AttachVolumeShelveTestJSON-1580389683</nova:project>
Nov 09 00:42:38 user nova-compute[74441]:       </nova:owner>
Nov 09 00:42:38 user nova-compute[74441]:       <nova:root type="image" uuid="2d94e410-7990-4d3d-9a75-e470aa954ae2"/>
Nov 09 00:42:38 user nova-compute[74441]:       <nova:ports>
Nov 09 00:42:38 user nova-compute[74441]:         <nova:port uuid="958e30c3-1bcc-4902-8868-851d7f71c00e">
Nov 09 00:42:38 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 00:42:38 user nova-compute[74441]:         </nova:port>
Nov 09 00:42:38 user nova-compute[74441]:       </nova:ports>
Nov 09 00:42:38 user nova-compute[74441]:     </nova:instance>
Nov 09 00:42:38 user nova-compute[74441]:   </metadata>
Nov 09 00:42:38 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:42:38 user nova-compute[74441]:     <system>
Nov 09 00:42:38 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:42:38 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:42:38 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:42:38 user nova-compute[74441]:       <entry name="serial">d717ddbc-6c16-4b0b-812a-6cb46b5314dc</entry>
Nov 09 00:42:38 user nova-compute[74441]:       <entry name="uuid">d717ddbc-6c16-4b0b-812a-6cb46b5314dc</entry>
Nov 09 00:42:38 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:42:38 user nova-compute[74441]:     </system>
Nov 09 00:42:38 user nova-compute[74441]:   </sysinfo>
Nov 09 00:42:38 user nova-compute[74441]:   <os>
Nov 09 00:42:38 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:42:38 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:42:38 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:42:38 user nova-compute[74441]:   </os>
Nov 09 00:42:38 user nova-compute[74441]:   <features>
Nov 09 00:42:38 user nova-compute[74441]:     <acpi/>
Nov 09 00:42:38 user nova-compute[74441]:     <apic/>
Nov 09 00:42:38 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:42:38 user nova-compute[74441]:   </features>
Nov 09 00:42:38 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:42:38 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:42:38 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:42:38 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:42:38 user nova-compute[74441]:   </clock>
Nov 09 00:42:38 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:42:38 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:42:38 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:42:38 user nova-compute[74441]:   </cpu>
Nov 09 00:42:38 user nova-compute[74441]:   <devices>
Nov 09 00:42:38 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:42:38 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:42:38 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk"/>
Nov 09 00:42:38 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:42:38 user nova-compute[74441]:     </disk>
Nov 09 00:42:38 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:42:38 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:42:38 user nova-compute[74441]:       <source dev="/dev/sdg"/>
Nov 09 00:42:38 user nova-compute[74441]:       <target dev="vdc" bus="virtio"/>
Nov 09 00:42:38 user nova-compute[74441]:       <serial>ba6803b0-0980-4c35-b7aa-3e0a516ddbc8</serial>
Nov 09 00:42:38 user nova-compute[74441]:     </disk>
Nov 09 00:42:38 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:42:38 user nova-compute[74441]:       <mac address="fa:16:3e:fd:53:97"/>
Nov 09 00:42:38 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:42:38 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:42:38 user nova-compute[74441]:       <target dev="tap958e30c3-1b"/>
Nov 09 00:42:38 user nova-compute[74441]:     </interface>
Nov 09 00:42:38 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:42:38 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/console.log" append="off"/>
Nov 09 00:42:38 user nova-compute[74441]:     </serial>
Nov 09 00:42:38 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:42:38 user nova-compute[74441]:     <video>
Nov 09 00:42:38 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:42:38 user nova-compute[74441]:     </video>
Nov 09 00:42:38 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:42:38 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:42:38 user nova-compute[74441]:     </rng>
Nov 09 00:42:38 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:42:38 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:42:38 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:42:38 user nova-compute[74441]:     </memballoon>
Nov 09 00:42:38 user nova-compute[74441]:   </devices>
Nov 09 00:42:38 user nova-compute[74441]: </domain>
Nov 09 00:42:38 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-88303642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-88303642',id=2,image_ref='2d94e410-7990-4d3d-9a75-e470aa954ae2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-555090617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-xa6rl5bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member',shelved_at='2023-11-09T00:40:09.152551',shelved_host='user',shelved_image_id='2d94e410-7990-4d3d-9a75-e470aa954ae2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=d717ddbc-6c16-4b0b-812a-6cb46b5314dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG os_vif [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65407fe9-95a2-5b22-b397-29fc18ef137f', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap958e30c3-1b, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap958e30c3-1b, col_values=(('qos', UUID('f71c11b0-37b6-4825-bec5-0a510cda92a3')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap958e30c3-1b, col_values=(('external_ids', {'iface-id': '958e30c3-1bcc-4902-8868-851d7f71c00e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:53:97', 'vm-uuid': 'd717ddbc-6c16-4b0b-812a-6cb46b5314dc'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:38 user nova-compute[74441]: INFO os_vif [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b')
Nov 09 00:42:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:42:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:42:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No VIF found with MAC fa:16:3e:fd:53:97, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-f7588fe0-6eda-4484-bbd3-95076a86d46e req-59f810ac-c8ed-4637-9a36-4cc3b36aa5fe service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f7588fe0-6eda-4484-bbd3-95076a86d46e req-59f810ac-c8ed-4637-9a36-4cc3b36aa5fe service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f7588fe0-6eda-4484-bbd3-95076a86d46e req-59f810ac-c8ed-4637-9a36-4cc3b36aa5fe service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f7588fe0-6eda-4484-bbd3-95076a86d46e req-59f810ac-c8ed-4637-9a36-4cc3b36aa5fe service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-f7588fe0-6eda-4484-bbd3-95076a86d46e req-59f810ac-c8ed-4637-9a36-4cc3b36aa5fe service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:40 user nova-compute[74441]: WARNING nova.compute.manager [req-f7588fe0-6eda-4484-bbd3-95076a86d46e req-59f810ac-c8ed-4637-9a36-4cc3b36aa5fe service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 00:42:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-dc53a2c5-d9eb-4b4b-9e2e-734c1038d960 req-cbd79ac9-4813-4a57-8892-c4a559cd0a52 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dc53a2c5-d9eb-4b4b-9e2e-734c1038d960 req-cbd79ac9-4813-4a57-8892-c4a559cd0a52 service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dc53a2c5-d9eb-4b4b-9e2e-734c1038d960 req-cbd79ac9-4813-4a57-8892-c4a559cd0a52 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dc53a2c5-d9eb-4b4b-9e2e-734c1038d960 req-cbd79ac9-4813-4a57-8892-c4a559cd0a52 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-dc53a2c5-d9eb-4b4b-9e2e-734c1038d960 req-cbd79ac9-4813-4a57-8892-c4a559cd0a52 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:42 user nova-compute[74441]: WARNING nova.compute.manager [req-dc53a2c5-d9eb-4b4b-9e2e-734c1038d960 req-cbd79ac9-4813-4a57-8892-c4a559cd0a52 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 00:42:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:42:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:42:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance spawned successfully.
Nov 09 00:42:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:42:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-83cfd43c-d700-4207-957b-a936d11657ff tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 47.014s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:46 user nova-compute[74441]: INFO nova.compute.manager [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Terminating instance
Nov 09 00:42:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-d5609c57-01f7-4905-a8b4-7f37d1d4a304 req-2288e54b-5452-4799-a689-9b1bfc34588c service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-vif-unplugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d5609c57-01f7-4905-a8b4-7f37d1d4a304 req-2288e54b-5452-4799-a689-9b1bfc34588c service nova] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d5609c57-01f7-4905-a8b4-7f37d1d4a304 req-2288e54b-5452-4799-a689-9b1bfc34588c service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d5609c57-01f7-4905-a8b4-7f37d1d4a304 req-2288e54b-5452-4799-a689-9b1bfc34588c service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-d5609c57-01f7-4905-a8b4-7f37d1d4a304 req-2288e54b-5452-4799-a689-9b1bfc34588c service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] No waiting events found dispatching network-vif-unplugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-d5609c57-01f7-4905-a8b4-7f37d1d4a304 req-2288e54b-5452-4799-a689-9b1bfc34588c service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-vif-unplugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:47 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Instance destroyed successfully.
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.objects.instance [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lazy-loading 'resources' on Instance uuid 431c09e0-3913-46e9-8050-c5c6ac81be71 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-850421750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8504217',id=7,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9QoRd37pH4mv8XQwkhw2z42dojojTgWg89wZkdLYtFiJmASEqVgkqQ3FfmhPOM21E1fVoxRitz3WzWROX4wRYZrgXfh0w2LUEPvdkHu+baXbi6BOCptc3KedFoe7TCDg==',key_name='tempest-keypair-1743331967',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0e88f3d5e07493b86f8d80a0245297e',ramdisk_id='',reservation_id='r-bhe3x4vj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1083770680',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e52582360c94d3baefc0c6dddcd5d5a',uuid=431c09e0-3913-46e9-8050-c5c6ac81be71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Converting VIF {"id": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "address": "fa:16:3e:b6:1a:1d", "network": {"id": "d473549c-0114-4822-914e-0968817b9615", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-638724031-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0e88f3d5e07493b86f8d80a0245297e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap592ffed4-c2", "ovs_interfaceid": "592ffed4-c218-4cf6-a1f4-1d89d11435c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG os_vif [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap592ffed4-c2, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e936e9a7-6ab7-407b-b72d-325ee619ab92) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: INFO os_vif [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1a:1d,bridge_name='br-int',has_traffic_filtering=True,id=592ffed4-c218-4cf6-a1f4-1d89d11435c5,network=Network(d473549c-0114-4822-914e-0968817b9615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap592ffed4-c2')
Nov 09 00:42:47 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Deleting instance files /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71_del
Nov 09 00:42:47 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Deletion of /opt/stack/data/nova/instances/431c09e0-3913-46e9-8050-c5c6ac81be71_del complete
Nov 09 00:42:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:42:47 user nova-compute[74441]: INFO nova.compute.manager [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 09 00:42:47 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updating instance_info_cache with network_info: [{"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-a35832ac-1910-4496-b14e-fcb99b973e41" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:42:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-a472c956-0149-4832-836b-192a66926ae1 req-e4d59eb4-29fc-4ce9-bd08-f3d247f415b5 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a472c956-0149-4832-836b-192a66926ae1 req-e4d59eb4-29fc-4ce9-bd08-f3d247f415b5 service nova] Acquiring lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a472c956-0149-4832-836b-192a66926ae1 req-e4d59eb4-29fc-4ce9-bd08-f3d247f415b5 service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a472c956-0149-4832-836b-192a66926ae1 req-e4d59eb4-29fc-4ce9-bd08-f3d247f415b5 service nova] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-a472c956-0149-4832-836b-192a66926ae1 req-e4d59eb4-29fc-4ce9-bd08-f3d247f415b5 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] No waiting events found dispatching network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:48 user nova-compute[74441]: WARNING nova.compute.manager [req-a472c956-0149-4832-836b-192a66926ae1 req-e4d59eb4-29fc-4ce9-bd08-f3d247f415b5 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received unexpected event network-vif-plugged-592ffed4-c218-4cf6-a1f4-1d89d11435c5 for instance with vm_state active and task_state deleting.
Nov 09 00:42:48 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Took 1.43 seconds to deallocate network for instance.
Nov 09 00:42:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-0f695b2c-45fd-43b4-938a-382f58c18165 req-9234e802-56c2-43ac-9147-6b50184c5a16 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Received event network-vif-deleted-592ffed4-c218-4cf6-a1f4-1d89d11435c5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:48 user nova-compute[74441]: INFO nova.compute.manager [req-0f695b2c-45fd-43b4-938a-382f58c18165 req-9234e802-56c2-43ac-9147-6b50184c5a16 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Neutron deleted interface 592ffed4-c218-4cf6-a1f4-1d89d11435c5; detaching it from the instance and deleting it from the info cache
Nov 09 00:42:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-0f695b2c-45fd-43b4-938a-382f58c18165 req-9234e802-56c2-43ac-9147-6b50184c5a16 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-0f695b2c-45fd-43b4-938a-382f58c18165 req-9234e802-56c2-43ac-9147-6b50184c5a16 service nova] [instance: 431c09e0-3913-46e9-8050-c5c6ac81be71] Detach interface failed, port_id=592ffed4-c218-4cf6-a1f4-1d89d11435c5, reason: Instance 431c09e0-3913-46e9-8050-c5c6ac81be71 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.175s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:42:49 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Deleted allocations for instance 431c09e0-3913-46e9-8050-c5c6ac81be71
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1115db14-1b50-43e1-9b8a-b214ddd35d89 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680 tempest-TestServerVolumeAttachScenarioOldVersion-1083770680-project-member] Lock "431c09e0-3913-46e9-8050-c5c6ac81be71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.436s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-changed-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing instance network info cache due to event network-changed-d0ba3d80-8917-462f-991c-c2d0cc3cd435. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] Acquiring lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] Acquired lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.network.neutron [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Refreshing network info cache for port d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 req-66b2c9a1-4473-4c90-87ba-078cfe311ab9 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event volume-reimaged-8540ef16-d3c0-427d-a8df-7e7eac6be287 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 req-66b2c9a1-4473-4c90-87ba-078cfe311ab9 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 req-66b2c9a1-4473-4c90-87ba-078cfe311ab9 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 req-66b2c9a1-4473-4c90-87ba-078cfe311ab9 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 req-66b2c9a1-4473-4c90-87ba-078cfe311ab9 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Processing event volume-reimaged-8540ef16-d3c0-427d-a8df-7e7eac6be287 {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance event wait completed in 59 seconds for volume-reimaged {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: INFO nova.virt.block_device [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Booting with volume 8540ef16-d3c0-427d-a8df-7e7eac6be287 at /dev/vda
Nov 09 00:42:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Waiting for libvirt event about the detach of device tap2ab19211-0c with device alias net1 from instance f4bd46e4-44cb-4b47-9781-4adece881c74 is timed out.
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface> {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface>not found in domain: <domain type='kvm' id='4'>
Nov 09 00:42:51 user nova-compute[74441]:   <name>instance-00000004</name>
Nov 09 00:42:51 user nova-compute[74441]:   <uuid>f4bd46e4-44cb-4b47-9781-4adece881c74</uuid>
Nov 09 00:42:51 user nova-compute[74441]:   <metadata>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:51 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:40:16</nova:creationTime>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:42:51 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:51 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:owner>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:42:51 user nova-compute[74441]:   </nova:owner>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:ports>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:42:51 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:42:51 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:port uuid="2ab19211-0ca7-44bb-8e1e-4cbcafe02175">
Nov 09 00:42:51 user nova-compute[74441]:       <nova:ip type="fixed" address="10.10.10.128" ipVersion="4"/>
Nov 09 00:42:51 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:51 user nova-compute[74441]:   </nova:ports>
Nov 09 00:42:51 user nova-compute[74441]: </nova:instance>
Nov 09 00:42:51 user nova-compute[74441]:   </metadata>
Nov 09 00:42:51 user nova-compute[74441]:   <memory unit='KiB'>524288</memory>
Nov 09 00:42:51 user nova-compute[74441]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 00:42:51 user nova-compute[74441]:   <vcpu placement='static'>1</vcpu>
Nov 09 00:42:51 user nova-compute[74441]:   <resource>
Nov 09 00:42:51 user nova-compute[74441]:     <partition>/machine</partition>
Nov 09 00:42:51 user nova-compute[74441]:   </resource>
Nov 09 00:42:51 user nova-compute[74441]:   <sysinfo type='smbios'>
Nov 09 00:42:51 user nova-compute[74441]:     <system>
Nov 09 00:42:51 user nova-compute[74441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 00:42:51 user nova-compute[74441]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 00:42:51 user nova-compute[74441]:       <entry name='version'>0.0.0</entry>
Nov 09 00:42:51 user nova-compute[74441]:       <entry name='serial'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:51 user nova-compute[74441]:       <entry name='uuid'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:51 user nova-compute[74441]:       <entry name='family'>Virtual Machine</entry>
Nov 09 00:42:51 user nova-compute[74441]:     </system>
Nov 09 00:42:51 user nova-compute[74441]:   </sysinfo>
Nov 09 00:42:51 user nova-compute[74441]:   <os>
Nov 09 00:42:51 user nova-compute[74441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 00:42:51 user nova-compute[74441]:     <boot dev='hd'/>
Nov 09 00:42:51 user nova-compute[74441]:     <smbios mode='sysinfo'/>
Nov 09 00:42:51 user nova-compute[74441]:   </os>
Nov 09 00:42:51 user nova-compute[74441]:   <features>
Nov 09 00:42:51 user nova-compute[74441]:     <acpi/>
Nov 09 00:42:51 user nova-compute[74441]:     <apic/>
Nov 09 00:42:51 user nova-compute[74441]:     <vmcoreinfo state='on'/>
Nov 09 00:42:51 user nova-compute[74441]:   </features>
Nov 09 00:42:51 user nova-compute[74441]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 00:42:51 user nova-compute[74441]:     <model fallback='forbid'>Nehalem</model>
Nov 09 00:42:51 user nova-compute[74441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 00:42:51 user nova-compute[74441]:     <feature policy='require' name='vme'/>
Nov 09 00:42:51 user nova-compute[74441]:     <feature policy='require' name='x2apic'/>
Nov 09 00:42:51 user nova-compute[74441]:     <feature policy='require' name='hypervisor'/>
Nov 09 00:42:51 user nova-compute[74441]:   </cpu>
Nov 09 00:42:51 user nova-compute[74441]:   <clock offset='utc'>
Nov 09 00:42:51 user nova-compute[74441]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 00:42:51 user nova-compute[74441]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 00:42:51 user nova-compute[74441]:     <timer name='hpet' present='no'/>
Nov 09 00:42:51 user nova-compute[74441]:   </clock>
Nov 09 00:42:51 user nova-compute[74441]:   <on_poweroff>destroy</on_poweroff>
Nov 09 00:42:51 user nova-compute[74441]:   <on_reboot>restart</on_reboot>
Nov 09 00:42:51 user nova-compute[74441]:   <on_crash>destroy</on_crash>
Nov 09 00:42:51 user nova-compute[74441]:   <devices>
Nov 09 00:42:51 user nova-compute[74441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 00:42:51 user nova-compute[74441]:     <disk type='file' device='disk'>
Nov 09 00:42:51 user nova-compute[74441]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 00:42:51 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk' index='2'/>
Nov 09 00:42:51 user nova-compute[74441]:       <backingStore type='file' index='3'>
Nov 09 00:42:51 user nova-compute[74441]:         <format type='raw'/>
Nov 09 00:42:51 user nova-compute[74441]:         <source file='/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4'/>
Nov 09 00:42:51 user nova-compute[74441]:         <backingStore/>
Nov 09 00:42:51 user nova-compute[74441]:       </backingStore>
Nov 09 00:42:51 user nova-compute[74441]:       <target dev='vda' bus='virtio'/>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='virtio-disk0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </disk>
Nov 09 00:42:51 user nova-compute[74441]:     <disk type='file' device='cdrom'>
Nov 09 00:42:51 user nova-compute[74441]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 00:42:51 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config' index='1'/>
Nov 09 00:42:51 user nova-compute[74441]:       <backingStore/>
Nov 09 00:42:51 user nova-compute[74441]:       <target dev='hda' bus='ide'/>
Nov 09 00:42:51 user nova-compute[74441]:       <readonly/>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='ide0-0-0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </disk>
Nov 09 00:42:51 user nova-compute[74441]:     <controller type='usb' index='0' model='none'>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='usb'/>
Nov 09 00:42:51 user nova-compute[74441]:     </controller>
Nov 09 00:42:51 user nova-compute[74441]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='pci.0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </controller>
Nov 09 00:42:51 user nova-compute[74441]:     <controller type='ide' index='0'>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='ide'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 00:42:51 user nova-compute[74441]:     </controller>
Nov 09 00:42:51 user nova-compute[74441]:     <interface type='ethernet'>
Nov 09 00:42:51 user nova-compute[74441]:       <mac address='fa:16:3e:d3:4b:2d'/>
Nov 09 00:42:51 user nova-compute[74441]:       <target dev='tap791979c2-d1'/>
Nov 09 00:42:51 user nova-compute[74441]:       <model type='virtio'/>
Nov 09 00:42:51 user nova-compute[74441]:       <mtu size='1442'/>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='net0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </interface>
Nov 09 00:42:51 user nova-compute[74441]:     <serial type='pty'>
Nov 09 00:42:51 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:51 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:51 user nova-compute[74441]:       <target type='isa-serial' port='0'>
Nov 09 00:42:51 user nova-compute[74441]:         <model name='isa-serial'/>
Nov 09 00:42:51 user nova-compute[74441]:       </target>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </serial>
Nov 09 00:42:51 user nova-compute[74441]:     <console type='pty' tty='/dev/pts/3'>
Nov 09 00:42:51 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:51 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:51 user nova-compute[74441]:       <target type='serial' port='0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </console>
Nov 09 00:42:51 user nova-compute[74441]:     <input type='mouse' bus='ps2'>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='input0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </input>
Nov 09 00:42:51 user nova-compute[74441]:     <input type='keyboard' bus='ps2'>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='input1'/>
Nov 09 00:42:51 user nova-compute[74441]:     </input>
Nov 09 00:42:51 user nova-compute[74441]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 09 00:42:51 user nova-compute[74441]:       <listen type='address' address='0.0.0.0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </graphics>
Nov 09 00:42:51 user nova-compute[74441]:     <audio id='1' type='none'/>
Nov 09 00:42:51 user nova-compute[74441]:     <video>
Nov 09 00:42:51 user nova-compute[74441]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='video0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </video>
Nov 09 00:42:51 user nova-compute[74441]:     <memballoon model='virtio'>
Nov 09 00:42:51 user nova-compute[74441]:       <stats period='10'/>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='balloon0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </memballoon>
Nov 09 00:42:51 user nova-compute[74441]:     <rng model='virtio'>
Nov 09 00:42:51 user nova-compute[74441]:       <backend model='random'>/dev/urandom</backend>
Nov 09 00:42:51 user nova-compute[74441]:       <alias name='rng0'/>
Nov 09 00:42:51 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 00:42:51 user nova-compute[74441]:     </rng>
Nov 09 00:42:51 user nova-compute[74441]:   </devices>
Nov 09 00:42:51 user nova-compute[74441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 00:42:51 user nova-compute[74441]:     <label>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</label>
Nov 09 00:42:51 user nova-compute[74441]:     <imagelabel>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</imagelabel>
Nov 09 00:42:51 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:51 user nova-compute[74441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 00:42:51 user nova-compute[74441]:     <label>+64055:+108</label>
Nov 09 00:42:51 user nova-compute[74441]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 00:42:51 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:51 user nova-compute[74441]: </domain>
Nov 09 00:42:51 user nova-compute[74441]:  {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 00:42:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully detached device tap2ab19211-0c from instance f4bd46e4-44cb-4b47-9781-4adece881c74 from the live domain config.
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG os_vif [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab19211-0c, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2bca67a-9643-4b37-953d-c53f2a6fb965) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: INFO os_vif [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c')
Nov 09 00:42:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:51 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:42:51</nova:creationTime>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:42:51 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:51 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:owner>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:42:51 user nova-compute[74441]:   </nova:owner>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:42:51 user nova-compute[74441]:   <nova:ports>
Nov 09 00:42:51 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:42:51 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:42:51 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:51 user nova-compute[74441]:   </nova:ports>
Nov 09 00:42:51 user nova-compute[74441]: </nova:instance>
Nov 09 00:42:51 user nova-compute[74441]:  {{(pid=74441) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG os_brick.utils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ad6cba-4029-4196-818f-f5948d1ce4ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb619fb9-fd97-458b-81c2-3ac8fce1a678]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca99e61-56b4-46ff-8402-3d03e6324869]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf6a50a-8670-449c-840c-865c0d4d0c11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:42:52 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca011ef-60c5-4e7a-8210-f559c8dd85f6]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG os_brick.utils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating existing volume attachment record: f4072198-46d4-4d8a-bfe0-dc35e73fc86a {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.network.neutron [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updated VIF entry in instance network info cache for port d0ba3d80-8917-462f-991c-c2d0cc3cd435. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.network.neutron [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:52 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:42:52 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8019MB free_disk=25.38180160522461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e0456ce-2f6f-4867-ac18-da00e0728d00 req-dbe624b8-e46f-49a2-978a-095b248f3cfb service nova] Releasing lock "refresh_cache-6e7a69cc-14e9-4a6f-b736-e74de84f8220" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquired lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:42:52 user nova-compute[74441]: DEBUG nova.network.neutron [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 265471cf-50b2-4759-a485-fa5e2a4e50a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance f4bd46e4-44cb-4b47-9781-4adece881c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance a35832ac-1910-4496-b14e-fcb99b973e41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7e394947-6c4c-4724-a566-ea34b44dd220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ffd43df5-7473-4cbf-aac1-52711f08e730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6e7a69cc-14e9-4a6f-b736-e74de84f8220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-deleted-2ab19211-0ca7-44bb-8e1e-4cbcafe02175 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:53 user nova-compute[74441]: INFO nova.compute.manager [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Neutron deleted interface 2ab19211-0ca7-44bb-8e1e-4cbcafe02175; detaching it from the instance and deleting it from the info cache
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.network.neutron [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.objects.instance [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Lazy-loading 'system_metadata' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.objects.instance [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Lazy-loading 'flavor' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.objects.base [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Object Instance<f4bd46e4-44cb-4b47-9781-4adece881c74> lazy-loaded attributes: system_metadata,flavor {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.network.os_vif_util [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Converting VIF {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.network.os_vif_util [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface> {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface>not found in domain: <domain type='kvm' id='4'>
Nov 09 00:42:53 user nova-compute[74441]:   <name>instance-00000004</name>
Nov 09 00:42:53 user nova-compute[74441]:   <uuid>f4bd46e4-44cb-4b47-9781-4adece881c74</uuid>
Nov 09 00:42:53 user nova-compute[74441]:   <metadata>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:53 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:42:51</nova:creationTime>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:42:53 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:owner>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:owner>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:ports>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:42:53 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:42:53 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:ports>
Nov 09 00:42:53 user nova-compute[74441]: </nova:instance>
Nov 09 00:42:53 user nova-compute[74441]:   </metadata>
Nov 09 00:42:53 user nova-compute[74441]:   <memory unit='KiB'>524288</memory>
Nov 09 00:42:53 user nova-compute[74441]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 00:42:53 user nova-compute[74441]:   <vcpu placement='static'>1</vcpu>
Nov 09 00:42:53 user nova-compute[74441]:   <resource>
Nov 09 00:42:53 user nova-compute[74441]:     <partition>/machine</partition>
Nov 09 00:42:53 user nova-compute[74441]:   </resource>
Nov 09 00:42:53 user nova-compute[74441]:   <sysinfo type='smbios'>
Nov 09 00:42:53 user nova-compute[74441]:     <system>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='version'>0.0.0</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='serial'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='uuid'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='family'>Virtual Machine</entry>
Nov 09 00:42:53 user nova-compute[74441]:     </system>
Nov 09 00:42:53 user nova-compute[74441]:   </sysinfo>
Nov 09 00:42:53 user nova-compute[74441]:   <os>
Nov 09 00:42:53 user nova-compute[74441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 00:42:53 user nova-compute[74441]:     <boot dev='hd'/>
Nov 09 00:42:53 user nova-compute[74441]:     <smbios mode='sysinfo'/>
Nov 09 00:42:53 user nova-compute[74441]:   </os>
Nov 09 00:42:53 user nova-compute[74441]:   <features>
Nov 09 00:42:53 user nova-compute[74441]:     <acpi/>
Nov 09 00:42:53 user nova-compute[74441]:     <apic/>
Nov 09 00:42:53 user nova-compute[74441]:     <vmcoreinfo state='on'/>
Nov 09 00:42:53 user nova-compute[74441]:   </features>
Nov 09 00:42:53 user nova-compute[74441]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 00:42:53 user nova-compute[74441]:     <model fallback='forbid'>Nehalem</model>
Nov 09 00:42:53 user nova-compute[74441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 00:42:53 user nova-compute[74441]:     <feature policy='require' name='vme'/>
Nov 09 00:42:53 user nova-compute[74441]:     <feature policy='require' name='x2apic'/>
Nov 09 00:42:53 user nova-compute[74441]:     <feature policy='require' name='hypervisor'/>
Nov 09 00:42:53 user nova-compute[74441]:   </cpu>
Nov 09 00:42:53 user nova-compute[74441]:   <clock offset='utc'>
Nov 09 00:42:53 user nova-compute[74441]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 00:42:53 user nova-compute[74441]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 00:42:53 user nova-compute[74441]:     <timer name='hpet' present='no'/>
Nov 09 00:42:53 user nova-compute[74441]:   </clock>
Nov 09 00:42:53 user nova-compute[74441]:   <on_poweroff>destroy</on_poweroff>
Nov 09 00:42:53 user nova-compute[74441]:   <on_reboot>restart</on_reboot>
Nov 09 00:42:53 user nova-compute[74441]:   <on_crash>destroy</on_crash>
Nov 09 00:42:53 user nova-compute[74441]:   <devices>
Nov 09 00:42:53 user nova-compute[74441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 00:42:53 user nova-compute[74441]:     <disk type='file' device='disk'>
Nov 09 00:42:53 user nova-compute[74441]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 00:42:53 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk' index='2'/>
Nov 09 00:42:53 user nova-compute[74441]:       <backingStore type='file' index='3'>
Nov 09 00:42:53 user nova-compute[74441]:         <format type='raw'/>
Nov 09 00:42:53 user nova-compute[74441]:         <source file='/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4'/>
Nov 09 00:42:53 user nova-compute[74441]:         <backingStore/>
Nov 09 00:42:53 user nova-compute[74441]:       </backingStore>
Nov 09 00:42:53 user nova-compute[74441]:       <target dev='vda' bus='virtio'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='virtio-disk0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </disk>
Nov 09 00:42:53 user nova-compute[74441]:     <disk type='file' device='cdrom'>
Nov 09 00:42:53 user nova-compute[74441]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 00:42:53 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config' index='1'/>
Nov 09 00:42:53 user nova-compute[74441]:       <backingStore/>
Nov 09 00:42:53 user nova-compute[74441]:       <target dev='hda' bus='ide'/>
Nov 09 00:42:53 user nova-compute[74441]:       <readonly/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='ide0-0-0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </disk>
Nov 09 00:42:53 user nova-compute[74441]:     <controller type='usb' index='0' model='none'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='usb'/>
Nov 09 00:42:53 user nova-compute[74441]:     </controller>
Nov 09 00:42:53 user nova-compute[74441]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='pci.0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </controller>
Nov 09 00:42:53 user nova-compute[74441]:     <controller type='ide' index='0'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='ide'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 00:42:53 user nova-compute[74441]:     </controller>
Nov 09 00:42:53 user nova-compute[74441]:     <interface type='ethernet'>
Nov 09 00:42:53 user nova-compute[74441]:       <mac address='fa:16:3e:d3:4b:2d'/>
Nov 09 00:42:53 user nova-compute[74441]:       <target dev='tap791979c2-d1'/>
Nov 09 00:42:53 user nova-compute[74441]:       <model type='virtio'/>
Nov 09 00:42:53 user nova-compute[74441]:       <mtu size='1442'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='net0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </interface>
Nov 09 00:42:53 user nova-compute[74441]:     <serial type='pty'>
Nov 09 00:42:53 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:53 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:53 user nova-compute[74441]:       <target type='isa-serial' port='0'>
Nov 09 00:42:53 user nova-compute[74441]:         <model name='isa-serial'/>
Nov 09 00:42:53 user nova-compute[74441]:       </target>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </serial>
Nov 09 00:42:53 user nova-compute[74441]:     <console type='pty' tty='/dev/pts/3'>
Nov 09 00:42:53 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:53 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:53 user nova-compute[74441]:       <target type='serial' port='0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </console>
Nov 09 00:42:53 user nova-compute[74441]:     <input type='mouse' bus='ps2'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='input0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </input>
Nov 09 00:42:53 user nova-compute[74441]:     <input type='keyboard' bus='ps2'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='input1'/>
Nov 09 00:42:53 user nova-compute[74441]:     </input>
Nov 09 00:42:53 user nova-compute[74441]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 09 00:42:53 user nova-compute[74441]:       <listen type='address' address='0.0.0.0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </graphics>
Nov 09 00:42:53 user nova-compute[74441]:     <audio id='1' type='none'/>
Nov 09 00:42:53 user nova-compute[74441]:     <video>
Nov 09 00:42:53 user nova-compute[74441]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='video0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </video>
Nov 09 00:42:53 user nova-compute[74441]:     <memballoon model='virtio'>
Nov 09 00:42:53 user nova-compute[74441]:       <stats period='10'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='balloon0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </memballoon>
Nov 09 00:42:53 user nova-compute[74441]:     <rng model='virtio'>
Nov 09 00:42:53 user nova-compute[74441]:       <backend model='random'>/dev/urandom</backend>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='rng0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </rng>
Nov 09 00:42:53 user nova-compute[74441]:   </devices>
Nov 09 00:42:53 user nova-compute[74441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 00:42:53 user nova-compute[74441]:     <label>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</label>
Nov 09 00:42:53 user nova-compute[74441]:     <imagelabel>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</imagelabel>
Nov 09 00:42:53 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:53 user nova-compute[74441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 00:42:53 user nova-compute[74441]:     <label>+64055:+108</label>
Nov 09 00:42:53 user nova-compute[74441]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 00:42:53 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:53 user nova-compute[74441]: </domain>
Nov 09 00:42:53 user nova-compute[74441]:  {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface> {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c6:c5:99"/><model type="virtio"/><mtu size="1442"/><target dev="tap2ab19211-0c"/></interface>not found in domain: <domain type='kvm' id='4'>
Nov 09 00:42:53 user nova-compute[74441]:   <name>instance-00000004</name>
Nov 09 00:42:53 user nova-compute[74441]:   <uuid>f4bd46e4-44cb-4b47-9781-4adece881c74</uuid>
Nov 09 00:42:53 user nova-compute[74441]:   <metadata>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:53 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:42:51</nova:creationTime>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:42:53 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:owner>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:owner>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:ports>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:42:53 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:42:53 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:ports>
Nov 09 00:42:53 user nova-compute[74441]: </nova:instance>
Nov 09 00:42:53 user nova-compute[74441]:   </metadata>
Nov 09 00:42:53 user nova-compute[74441]:   <memory unit='KiB'>524288</memory>
Nov 09 00:42:53 user nova-compute[74441]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 00:42:53 user nova-compute[74441]:   <vcpu placement='static'>1</vcpu>
Nov 09 00:42:53 user nova-compute[74441]:   <resource>
Nov 09 00:42:53 user nova-compute[74441]:     <partition>/machine</partition>
Nov 09 00:42:53 user nova-compute[74441]:   </resource>
Nov 09 00:42:53 user nova-compute[74441]:   <sysinfo type='smbios'>
Nov 09 00:42:53 user nova-compute[74441]:     <system>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='version'>0.0.0</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='serial'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='uuid'>f4bd46e4-44cb-4b47-9781-4adece881c74</entry>
Nov 09 00:42:53 user nova-compute[74441]:       <entry name='family'>Virtual Machine</entry>
Nov 09 00:42:53 user nova-compute[74441]:     </system>
Nov 09 00:42:53 user nova-compute[74441]:   </sysinfo>
Nov 09 00:42:53 user nova-compute[74441]:   <os>
Nov 09 00:42:53 user nova-compute[74441]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 00:42:53 user nova-compute[74441]:     <boot dev='hd'/>
Nov 09 00:42:53 user nova-compute[74441]:     <smbios mode='sysinfo'/>
Nov 09 00:42:53 user nova-compute[74441]:   </os>
Nov 09 00:42:53 user nova-compute[74441]:   <features>
Nov 09 00:42:53 user nova-compute[74441]:     <acpi/>
Nov 09 00:42:53 user nova-compute[74441]:     <apic/>
Nov 09 00:42:53 user nova-compute[74441]:     <vmcoreinfo state='on'/>
Nov 09 00:42:53 user nova-compute[74441]:   </features>
Nov 09 00:42:53 user nova-compute[74441]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 00:42:53 user nova-compute[74441]:     <model fallback='forbid'>Nehalem</model>
Nov 09 00:42:53 user nova-compute[74441]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 00:42:53 user nova-compute[74441]:     <feature policy='require' name='vme'/>
Nov 09 00:42:53 user nova-compute[74441]:     <feature policy='require' name='x2apic'/>
Nov 09 00:42:53 user nova-compute[74441]:     <feature policy='require' name='hypervisor'/>
Nov 09 00:42:53 user nova-compute[74441]:   </cpu>
Nov 09 00:42:53 user nova-compute[74441]:   <clock offset='utc'>
Nov 09 00:42:53 user nova-compute[74441]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 00:42:53 user nova-compute[74441]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 00:42:53 user nova-compute[74441]:     <timer name='hpet' present='no'/>
Nov 09 00:42:53 user nova-compute[74441]:   </clock>
Nov 09 00:42:53 user nova-compute[74441]:   <on_poweroff>destroy</on_poweroff>
Nov 09 00:42:53 user nova-compute[74441]:   <on_reboot>restart</on_reboot>
Nov 09 00:42:53 user nova-compute[74441]:   <on_crash>destroy</on_crash>
Nov 09 00:42:53 user nova-compute[74441]:   <devices>
Nov 09 00:42:53 user nova-compute[74441]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 00:42:53 user nova-compute[74441]:     <disk type='file' device='disk'>
Nov 09 00:42:53 user nova-compute[74441]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 00:42:53 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk' index='2'/>
Nov 09 00:42:53 user nova-compute[74441]:       <backingStore type='file' index='3'>
Nov 09 00:42:53 user nova-compute[74441]:         <format type='raw'/>
Nov 09 00:42:53 user nova-compute[74441]:         <source file='/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4'/>
Nov 09 00:42:53 user nova-compute[74441]:         <backingStore/>
Nov 09 00:42:53 user nova-compute[74441]:       </backingStore>
Nov 09 00:42:53 user nova-compute[74441]:       <target dev='vda' bus='virtio'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='virtio-disk0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </disk>
Nov 09 00:42:53 user nova-compute[74441]:     <disk type='file' device='cdrom'>
Nov 09 00:42:53 user nova-compute[74441]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 00:42:53 user nova-compute[74441]:       <source file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/disk.config' index='1'/>
Nov 09 00:42:53 user nova-compute[74441]:       <backingStore/>
Nov 09 00:42:53 user nova-compute[74441]:       <target dev='hda' bus='ide'/>
Nov 09 00:42:53 user nova-compute[74441]:       <readonly/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='ide0-0-0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </disk>
Nov 09 00:42:53 user nova-compute[74441]:     <controller type='usb' index='0' model='none'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='usb'/>
Nov 09 00:42:53 user nova-compute[74441]:     </controller>
Nov 09 00:42:53 user nova-compute[74441]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='pci.0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </controller>
Nov 09 00:42:53 user nova-compute[74441]:     <controller type='ide' index='0'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='ide'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 00:42:53 user nova-compute[74441]:     </controller>
Nov 09 00:42:53 user nova-compute[74441]:     <interface type='ethernet'>
Nov 09 00:42:53 user nova-compute[74441]:       <mac address='fa:16:3e:d3:4b:2d'/>
Nov 09 00:42:53 user nova-compute[74441]:       <target dev='tap791979c2-d1'/>
Nov 09 00:42:53 user nova-compute[74441]:       <model type='virtio'/>
Nov 09 00:42:53 user nova-compute[74441]:       <mtu size='1442'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='net0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </interface>
Nov 09 00:42:53 user nova-compute[74441]:     <serial type='pty'>
Nov 09 00:42:53 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:53 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:53 user nova-compute[74441]:       <target type='isa-serial' port='0'>
Nov 09 00:42:53 user nova-compute[74441]:         <model name='isa-serial'/>
Nov 09 00:42:53 user nova-compute[74441]:       </target>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </serial>
Nov 09 00:42:53 user nova-compute[74441]:     <console type='pty' tty='/dev/pts/3'>
Nov 09 00:42:53 user nova-compute[74441]:       <source path='/dev/pts/3'/>
Nov 09 00:42:53 user nova-compute[74441]:       <log file='/opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74/console.log' append='off'/>
Nov 09 00:42:53 user nova-compute[74441]:       <target type='serial' port='0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='serial0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </console>
Nov 09 00:42:53 user nova-compute[74441]:     <input type='mouse' bus='ps2'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='input0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </input>
Nov 09 00:42:53 user nova-compute[74441]:     <input type='keyboard' bus='ps2'>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='input1'/>
Nov 09 00:42:53 user nova-compute[74441]:     </input>
Nov 09 00:42:53 user nova-compute[74441]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 09 00:42:53 user nova-compute[74441]:       <listen type='address' address='0.0.0.0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </graphics>
Nov 09 00:42:53 user nova-compute[74441]:     <audio id='1' type='none'/>
Nov 09 00:42:53 user nova-compute[74441]:     <video>
Nov 09 00:42:53 user nova-compute[74441]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='video0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </video>
Nov 09 00:42:53 user nova-compute[74441]:     <memballoon model='virtio'>
Nov 09 00:42:53 user nova-compute[74441]:       <stats period='10'/>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='balloon0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </memballoon>
Nov 09 00:42:53 user nova-compute[74441]:     <rng model='virtio'>
Nov 09 00:42:53 user nova-compute[74441]:       <backend model='random'>/dev/urandom</backend>
Nov 09 00:42:53 user nova-compute[74441]:       <alias name='rng0'/>
Nov 09 00:42:53 user nova-compute[74441]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 00:42:53 user nova-compute[74441]:     </rng>
Nov 09 00:42:53 user nova-compute[74441]:   </devices>
Nov 09 00:42:53 user nova-compute[74441]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 00:42:53 user nova-compute[74441]:     <label>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</label>
Nov 09 00:42:53 user nova-compute[74441]:     <imagelabel>libvirt-f4bd46e4-44cb-4b47-9781-4adece881c74</imagelabel>
Nov 09 00:42:53 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:53 user nova-compute[74441]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 00:42:53 user nova-compute[74441]:     <label>+64055:+108</label>
Nov 09 00:42:53 user nova-compute[74441]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 00:42:53 user nova-compute[74441]:   </seclabel>
Nov 09 00:42:53 user nova-compute[74441]: </domain>
Nov 09 00:42:53 user nova-compute[74441]:  {{(pid=74441) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 00:42:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Detaching interface fa:16:3e:c6:c5:99 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2ab19211-0c' not found.
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.network.os_vif_util [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Converting VIF {"id": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "address": "fa:16:3e:c6:c5:99", "network": {"id": "351c8b5d-f3e6-4d32-b4a0-637b49556caf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1991538500", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ab19211-0c", "ovs_interfaceid": "2ab19211-0ca7-44bb-8e1e-4cbcafe02175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.network.os_vif_util [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG os_vif [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:53 user nova-compute[74441]: INFO nova.network.neutron [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Port 2ab19211-0ca7-44bb-8e1e-4cbcafe02175 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [{"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ab19211-0c, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:42:53 user nova-compute[74441]: INFO os_vif [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:c5:99,bridge_name='br-int',has_traffic_filtering=True,id=2ab19211-0ca7-44bb-8e1e-4cbcafe02175,network=Network(351c8b5d-f3e6-4d32-b4a0-637b49556caf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ab19211-0c')
Nov 09 00:42:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [req-be21d3a4-e79d-4cef-86ba-6e8a93e2b579 req-1afe34d4-53f8-49c0-96fd-2fef53098cb3 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:42:53 user nova-compute[74441]:   <nova:package version="0.0.0"/>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:name>tempest-device-tagging-server-2143081500</nova:name>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:creationTime>2023-11-09 00:42:53</nova:creationTime>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:flavor name="m1.tiny">
Nov 09 00:42:53 user nova-compute[74441]:     <nova:memory>512</nova:memory>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:disk>1</nova:disk>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:swap>0</nova:swap>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:vcpus>1</nova:vcpus>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:flavor>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:owner>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:user uuid="adf38aba1dcf4d8e8cb89728ff19509b">tempest-TaggedAttachmentsTest-154539280-project-member</nova:user>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:project uuid="0ce510b60b4e444f930d32c5301698d6">tempest-TaggedAttachmentsTest-154539280</nova:project>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:owner>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:42:53 user nova-compute[74441]:   <nova:ports>
Nov 09 00:42:53 user nova-compute[74441]:     <nova:port uuid="791979c2-d197-4cdf-9d7a-a0a895ce47c6">
Nov 09 00:42:53 user nova-compute[74441]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:42:53 user nova-compute[74441]:     </nova:port>
Nov 09 00:42:53 user nova-compute[74441]:   </nova:ports>
Nov 09 00:42:53 user nova-compute[74441]: </nova:instance>
Nov 09 00:42:53 user nova-compute[74441]:  {{(pid=74441) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Releasing lock "refresh_cache-f4bd46e4-44cb-4b47-9781-4adece881c74" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-589fd724-4193-4b99-9d05-f2ebdf7e0640 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "interface-f4bd46e4-44cb-4b47-9781-4adece881c74-2ab19211-0ca7-44bb-8e1e-4cbcafe02175" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.609s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:54 user nova-compute[74441]: INFO nova.compute.manager [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Terminating instance
Nov 09 00:42:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-626bd5bf-1569-4852-a3a6-4569471a880d req-9b5f7d65-05bb-4916-8dae-38c2fcbe522d service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-626bd5bf-1569-4852-a3a6-4569471a880d req-9b5f7d65-05bb-4916-8dae-38c2fcbe522d service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-626bd5bf-1569-4852-a3a6-4569471a880d req-9b5f7d65-05bb-4916-8dae-38c2fcbe522d service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-626bd5bf-1569-4852-a3a6-4569471a880d req-9b5f7d65-05bb-4916-8dae-38c2fcbe522d service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-626bd5bf-1569-4852-a3a6-4569471a880d req-9b5f7d65-05bb-4916-8dae-38c2fcbe522d service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-626bd5bf-1569-4852-a3a6-4569471a880d req-9b5f7d65-05bb-4916-8dae-38c2fcbe522d service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:56 user nova-compute[74441]: WARNING nova.compute.manager [req-36135dc4-08d9-4640-b3f4-a3453f50d859 req-d4cfbaa3-54b9-4135-9a57-23a5a3a70ccf service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-d0ba3d80-8917-462f-991c-c2d0cc3cd435 for instance with vm_state active and task_state deleting.
Nov 09 00:42:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Instance destroyed successfully.
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lazy-loading 'resources' on Instance uuid 6e7a69cc-14e9-4a6f-b736-e74de84f8220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ba3d80-89, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dccd4439-b703-4fc6-9828-b769629314d4) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:0c:fa,bridge_name='br-int',has_traffic_filtering=True,id=d0ba3d80-8917-462f-991c-c2d0cc3cd435,network=Network(7adc6ccc-b9d1-405d-af82-12fed005a638),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ba3d80-89')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb68cc496-94, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-42cd53cc-f8e3-4edd-84a6-ecc155702a9f req-a3db84be-ac73-4a21-a6eb-4ef55742b649 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-42cd53cc-f8e3-4edd-84a6-ecc155702a9f req-a3db84be-ac73-4a21-a6eb-4ef55742b649 service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-42cd53cc-f8e3-4edd-84a6-ecc155702a9f req-a3db84be-ac73-4a21-a6eb-4ef55742b649 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-42cd53cc-f8e3-4edd-84a6-ecc155702a9f req-a3db84be-ac73-4a21-a6eb-4ef55742b649 service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-42cd53cc-f8e3-4edd-84a6-ecc155702a9f req-a3db84be-ac73-4a21-a6eb-4ef55742b649 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-42cd53cc-f8e3-4edd-84a6-ecc155702a9f req-a3db84be-ac73-4a21-a6eb-4ef55742b649 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58df9c43-680f-42d6-8157-508f693e13e0) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:c0:db,bridge_name='br-int',has_traffic_filtering=True,id=b68cc496-94c2-4b1e-8948-ae38830f1f31,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb68cc496-94')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacf304c2-5b, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=058a93d5-20bf-466b-897e-52f2b6dbef8f) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=acf304c2-5b24-48f8-bd04-50e61e1ab05e,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapacf304c2-5b')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2c21445-4d, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e903da20-eabf-4152-8306-0fb228ee9e61) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5b:a2,bridge_name='br-int',has_traffic_filtering=True,id=b2c21445-4dc4-45a4-80a0-20c5377f3ab9,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c21445-4d')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5c6a59c-bc, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80ed9943-3c19-4e02-818e-112d23f8ae2e) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:40:45,bridge_name='br-int',has_traffic_filtering=True,id=c5c6a59c-bc5e-40ea-9d14-b1422baa62f8,network=Network(3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c6a59c-bc')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "address": "fa:16:3e:b0:f8:70", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fa7df24-0c", "ovs_interfaceid": "3fa7df24-0caa-4bc8-9a42-d3ae43cf157a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fa7df24-0c, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=782ecca4-68d9-46b0-aab8-8c9ac43bc58a) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:f8:70,bridge_name='br-int',has_traffic_filtering=True,id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fa7df24-0c')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1669128512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1669128512',id=10,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuRu/IO2GSDCjnUf858R7bDXiymSsAi9/nnYwvl0sGTBJ91uvQNmp6MgydSr68YmraurjxGyBEq9NU+gGeSSADylBQ0vXfoZIwUMvA3v6sjTyVgZh+irpMOCyemOgvSdg==',key_name='tempest-keypair-838694496',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789f4722b46740f5909b90360503d651',ramdisk_id='',reservation_id='r-zsodk0as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1058018725',owner_user_name='tempest-TaggedBootDevicesTest-1058018725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26804e57dd3147418fb8986373a4563f',uuid=6e7a69cc-14e9-4a6f-b736-e74de84f8220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converting VIF {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b30ccb7-0d, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd808ddf-580b-43fd-9dfe-96f662b9db77) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:42:57 user nova-compute[74441]: INFO os_vif [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:2c:e7,bridge_name='br-int',has_traffic_filtering=True,id=8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f,network=Network(0b154199-86f1-47a5-9113-d8536076ef4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b30ccb7-0d')
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gQcORjXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:57 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-d7123d58-49e7-4ffb-b1c2-c4f89e4ddc14 req-40c82be6-bbad-4812-a9ba-559e8892492f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d7123d58-49e7-4ffb-b1c2-c4f89e4ddc14 req-40c82be6-bbad-4812-a9ba-559e8892492f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d7123d58-49e7-4ffb-b1c2-c4f89e4ddc14 req-40c82be6-bbad-4812-a9ba-559e8892492f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d7123d58-49e7-4ffb-b1c2-c4f89e4ddc14 req-40c82be6-bbad-4812-a9ba-559e8892492f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-d7123d58-49e7-4ffb-b1c2-c4f89e4ddc14 req-40c82be6-bbad-4812-a9ba-559e8892492f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:57 user nova-compute[74441]: WARNING nova.compute.manager [req-d7123d58-49e7-4ffb-b1c2-c4f89e4ddc14 req-40c82be6-bbad-4812-a9ba-559e8892492f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 for instance with vm_state active and task_state deleting.
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f474ed6d-f1f1-462c-8199-57b49eb6f7a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:42:57 user nova-compute[74441]: No targets found.
Nov 09 00:42:57 user nova-compute[74441]: iSNS:
Nov 09 00:42:57 user nova-compute[74441]: No targets found.
Nov 09 00:42:57 user nova-compute[74441]: STATIC:
Nov 09 00:42:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8
Nov 09 00:42:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b
Nov 09 00:42:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:42:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:42:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:42:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:57 user nova-compute[74441]: FIRMWARE:
Nov 09 00:42:57 user nova-compute[74441]: No targets found.
Nov 09 00:42:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:42:57 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:42:57 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd9a8de-0f84-4028-a593-0ffa218b463e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[196ba5ae-f36e-4d58-bbee-8bb2d812aa92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c62beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce42452-cd0d-4dbb-b27e-b0644d3fd6a7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc171298-d45f-49c9-9dc6-f55bcd678406]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d97e9-ea5f-486d-aa4d-19a4f39acf01]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06f0877-e762-4cb3-a970-15d7e1808232]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ccb658-5d99-4db7-bcbd-7445c982d842]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c54452a-7f52-40ee-8ae6-9a61084d03d4]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260]
Nov 09 00:42:58 user nova-compute[74441]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:58 user nova-compute[74441]: WARNING nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-b68cc496-94c2-4b1e-8948-ae38830f1f31 for instance with vm_state active and task_state deleting.
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:58 user nova-compute[74441]: WARNING nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 for instance with vm_state active and task_state deleting.
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:58 user nova-compute[74441]: WARNING nova.compute.manager [req-2409c799-5afa-4e39-916c-867cef155974 req-edb78256-167a-425f-98af-ad79edbe358f service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f for instance with vm_state active and task_state deleting.
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df89ea-53bd-43d4-81d7-79cebfc2899b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a81b42-69e1-4f31-a666-1781f838c556]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== disconnect_volume: return (440ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XmlDLRhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:58 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f02c79-8073-489b-b08e-eccfe25038c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:42:58 user nova-compute[74441]: No targets found.
Nov 09 00:42:58 user nova-compute[74441]: iSNS:
Nov 09 00:42:58 user nova-compute[74441]: No targets found.
Nov 09 00:42:58 user nova-compute[74441]: STATIC:
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: FIRMWARE:
Nov 09 00:42:58 user nova-compute[74441]: No targets found.
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:42:58 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:42:58 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86519d50-e924-4f84-b590-f70ed952b372]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9d9dd-09f4-4778-b4d2-ccf0d7e98ede]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c63de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6'): ({'sde'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Removing single pathed devices sde {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[64df3e04-a67e-4ac1-8e72-285af2920fce]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eae295-3555-4b55-8290-a9df7a8bb61f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Flushing IO for device /dev/sde {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5506b-6bca-41e3-9706-30cc7904f250]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.067s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a53a92d-31bb-4425-b29d-1500bb133112]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d640afef-12e4-47b3-9b53-cbaf0aba2e1d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc282a55-05df-455c-b0a2-ea0816050426]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260]
Nov 09 00:42:58 user nova-compute[74441]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:873e0202-35eb-4455-9a20-cf1f26aff8f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c1ae3-e9c4-46c0-9db2-d4dfe175ebd2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== disconnect_volume: return (428ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aMUvFQnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:42:58 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbe987b-4342-4f88-98b9-64f93105143e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:42:58 user nova-compute[74441]: No targets found.
Nov 09 00:42:58 user nova-compute[74441]: iSNS:
Nov 09 00:42:58 user nova-compute[74441]: No targets found.
Nov 09 00:42:58 user nova-compute[74441]: STATIC:
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255
Nov 09 00:42:58 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:42:58 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:42:58 user nova-compute[74441]: FIRMWARE:
Nov 09 00:42:58 user nova-compute[74441]: No targets found.
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:42:58 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:42:58 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff44fe8-bf3f-46e2-8ab8-7b5a037bc6b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd57d39-6233-4ab7-bd05-a689757fe503]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 (non-flash)
Nov 09 00:42:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c2ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c034a6-9ae2-4d67-98e6-6dcb740cc207]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da405cc-36b7-43a5-9809-9f6552843481]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[932048a0-098d-4985-a18c-292fb2acd37d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:42:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbe354-a8e4-4ac7-8884-5ff838d185ac]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d39034b-5031-4cb5-9ceb-930067b346fd]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e14c2-9cbe-474e-a1e3-cd94c166d44a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260]
Nov 09 00:42:59 user nova-compute[74441]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255, portal: 172.16.0.220,3260] successful.
Nov 09 00:42:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60873b71-53b8-4337-b171-07c6cae1a255 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d999ff2b-a59f-4135-8de3-ae703afa4cef]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] <== disconnect_volume: return (383ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:42:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Deleting instance files /opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220_del
Nov 09 00:42:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Deletion of /opt/stack/data/nova/instances/6e7a69cc-14e9-4a6f-b736-e74de84f8220_del complete
Nov 09 00:42:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:59 user nova-compute[74441]: INFO nova.compute.manager [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Took 4.78 seconds to destroy the instance on the hypervisor.
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:59 user nova-compute[74441]: WARNING nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-acf304c2-5b24-48f8-bd04-50e61e1ab05e for instance with vm_state active and task_state deleting.
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-unplugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-unplugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Acquiring lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] No waiting events found dispatching network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:42:59 user nova-compute[74441]: WARNING nova.compute.manager [req-88fbb3f3-5359-4f7c-90ef-c6e960e57a7f req-33714860-c51c-47f1-ac86-25b750fd72bb service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received unexpected event network-vif-plugged-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a for instance with vm_state active and task_state deleting.
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "7e394947-6c4c-4724-a566-ea34b44dd220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:42:59 user nova-compute[74441]: INFO nova.compute.manager [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Terminating instance
Nov 09 00:42:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:42:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Instance destroyed successfully.
Nov 09 00:43:00 user nova-compute[74441]: DEBUG nova.objects.instance [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lazy-loading 'resources' on Instance uuid 7e394947-6c4c-4724-a566-ea34b44dd220 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1851512831',display_name='tempest-VolumesAssistedSnapshotsTest-server-1851512831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1851512831',id=6,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKT9W7OGvFeXp6GY6B5zCp2Ntt0HiH0qrv90R4sE6bA/CjgPiyqJfvWIPGgppwYQslDGqLpYrqnx+GSbeExdvphMAeKr7XQDn+r0+rKg6nC8mu3gKlUN7x71+Xa6PKxsA==',key_name='tempest-keypair-395851799',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22bc50191ea845e992eea2c6f6af1682',ramdisk_id='',reservation_id='r-2oy2iwbv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1513411961',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1513411961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='154144f077d34d3fa6596ee14df5bdeb',uuid=7e394947-6c4c-4724-a566-ea34b44dd220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Converting VIF {"id": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "address": "fa:16:3e:95:dc:8b", "network": {"id": "7523464c-6952-4b9b-a6bf-7319c3cc874b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1211160942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22bc50191ea845e992eea2c6f6af1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb82ee0-f1", "ovs_interfaceid": "4fb82ee0-f1a0-406d-9143-83a86f7c617a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG os_vif [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb82ee0-f1, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03a2d4a9-1e77-45a8-9271-f6bfd632a260) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:00 user nova-compute[74441]: INFO os_vif [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:dc:8b,bridge_name='br-int',has_traffic_filtering=True,id=4fb82ee0-f1a0-406d-9143-83a86f7c617a,network=Network(7523464c-6952-4b9b-a6bf-7319c3cc874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb82ee0-f1')
Nov 09 00:43:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Deleting instance files /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220_del
Nov 09 00:43:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Deletion of /opt/stack/data/nova/instances/7e394947-6c4c-4724-a566-ea34b44dd220_del complete
Nov 09 00:43:00 user nova-compute[74441]: INFO nova.compute.manager [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 09 00:43:00 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:43:00 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:43:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-acef13bb-ff8d-4030-93ad-62d291547bef req-4b548575-8c6e-40c6-8bfa-c43aa9be9182 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-deleted-3fa7df24-0caa-4bc8-9a42-d3ae43cf157a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:01 user nova-compute[74441]: INFO nova.compute.manager [req-acef13bb-ff8d-4030-93ad-62d291547bef req-4b548575-8c6e-40c6-8bfa-c43aa9be9182 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Neutron deleted interface 3fa7df24-0caa-4bc8-9a42-d3ae43cf157a; detaching it from the instance and deleting it from the info cache
Nov 09 00:43:01 user nova-compute[74441]: DEBUG nova.network.neutron [req-acef13bb-ff8d-4030-93ad-62d291547bef req-4b548575-8c6e-40c6-8bfa-c43aa9be9182 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [{"id": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "address": "fa:16:3e:99:0c:fa", "network": {"id": "7adc6ccc-b9d1-405d-af82-12fed005a638", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-543341778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ba3d80-89", "ovs_interfaceid": "d0ba3d80-8917-462f-991c-c2d0cc3cd435", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "address": "fa:16:3e:c6:c0:db", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68cc496-94", "ovs_interfaceid": "b68cc496-94c2-4b1e-8948-ae38830f1f31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "address": "fa:16:3e:93:63:dd", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf304c2-5b", "ovs_interfaceid": "acf304c2-5b24-48f8-bd04-50e61e1ab05e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "address": "fa:16:3e:d7:5b:a2", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c21445-4d", "ovs_interfaceid": "b2c21445-4dc4-45a4-80a0-20c5377f3ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "address": "fa:16:3e:14:40:45", "network": {"id": "3bcf05d5-8079-4b99-bfb0-d75c2ffe3f4b", "bridge": "br-int", "label": "tempest-device-tagging-net1-98980719", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c6a59c-bc", "ovs_interfaceid": "c5c6a59c-bc5e-40ea-9d14-b1422baa62f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "address": "fa:16:3e:5a:2c:e7", "network": {"id": "0b154199-86f1-47a5-9113-d8536076ef4b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1884367627", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "789f4722b46740f5909b90360503d651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b30ccb7-0d", "ovs_interfaceid": "8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-acef13bb-ff8d-4030-93ad-62d291547bef req-4b548575-8c6e-40c6-8bfa-c43aa9be9182 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Detach interface failed, port_id=3fa7df24-0caa-4bc8-9a42-d3ae43cf157a, reason: Instance 6e7a69cc-14e9-4a6f-b736-e74de84f8220 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 00:43:01 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:01 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Took 1.01 seconds to deallocate network for instance.
Nov 09 00:43:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-8702244b-290c-4c7b-bae2-a70bf89e98af req-267fd67a-d373-417c-9b83-e665ede59863 service nova] [instance: 7e394947-6c4c-4724-a566-ea34b44dd220] Received event network-vif-deleted-4fb82ee0-f1a0-406d-9143-83a86f7c617a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:02 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:02 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:02 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Deleted allocations for instance 7e394947-6c4c-4724-a566-ea34b44dd220
Nov 09 00:43:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-98ddc5b8-4525-42db-913b-8ad0a87cd253 tempest-VolumesAssistedSnapshotsTest-1513411961 tempest-VolumesAssistedSnapshotsTest-1513411961-project-member] Lock "7e394947-6c4c-4724-a566-ea34b44dd220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.700s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:03 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:03 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Took 4.13 seconds to deallocate network for instance.
Nov 09 00:43:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-40a279cc-821b-4a0f-ad28-b6a51abd914f req-4a128ece-f867-4fb7-8c41-88619546e547 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-deleted-b2c21445-4dc4-45a4-80a0-20c5377f3ab9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-40a279cc-821b-4a0f-ad28-b6a51abd914f req-4a128ece-f867-4fb7-8c41-88619546e547 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-deleted-8b30ccb7-0d9d-479b-bbdc-4faa58f29e1f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-40a279cc-821b-4a0f-ad28-b6a51abd914f req-4a128ece-f867-4fb7-8c41-88619546e547 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-deleted-d0ba3d80-8917-462f-991c-c2d0cc3cd435 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-40a279cc-821b-4a0f-ad28-b6a51abd914f req-4a128ece-f867-4fb7-8c41-88619546e547 service nova] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Received event network-vif-deleted-c5c6a59c-bc5e-40ea-9d14-b1422baa62f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:43:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:04 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:43:04 user nova-compute[74441]: INFO nova.compute.claims [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Claim successful on node user
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:43:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.policy [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d2d3eb3c7104c9b8f1fd56fd44b8933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6403e99121d4daba82abd58c7ecb708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:43:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Creating image(s)
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "1d17c2596d9a1d6c69655a556db1e73afeeec7d8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "1d17c2596d9a1d6c69655a556db1e73afeeec7d8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.virt.images [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] 2c077062-0ceb-4a75-8d5b-5809f495e901 was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.part /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Successfully created port: f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.part /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.converted" returned: 0 in 0.435s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "1d17c2596d9a1d6c69655a556db1e73afeeec7d8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.217s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "1d17c2596d9a1d6c69655a556db1e73afeeec7d8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "1d17c2596d9a1d6c69655a556db1e73afeeec7d8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8,backing_fmt=raw /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Successfully updated port: f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing instance network info cache due to event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG nova.network.neutron [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8,backing_fmt=raw /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk 1073741824" returned: 0 in 0.058s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "1d17c2596d9a1d6c69655a556db1e73afeeec7d8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Cannot resize image /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Ensure instance console log exists: /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b06450f0-b741-4800-944e-353d8d123120 req-0e367892-c358-4f1f-bcf5-aba6380261f5 service nova] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance network_info: |[{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Start _get_guest_xml network_info=[{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:43:01Z,direct_url=<?>,disk_format='qcow2',id=2c077062-0ceb-4a75-8d5b-5809f495e901,min_disk=0,min_ram=0,name='tempest-scenario-img--1449856261',owner='e6403e99121d4daba82abd58c7ecb708',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:43:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '2c077062-0ceb-4a75-8d5b-5809f495e901'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:43:07 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:43:07 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:43:01Z,direct_url=<?>,disk_format='qcow2',id=2c077062-0ceb-4a75-8d5b-5809f495e901,min_disk=0,min_ram=0,name='tempest-scenario-img--1449856261',owner='e6403e99121d4daba82abd58c7ecb708',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:43:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1708721978',display_name='tempest-TestMinimumBasicScenario-server-1708721978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1708721978',id=11,image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1DyXAVVagm42WZaoBwEG/24CEZ37Beb75VSiZDVu4Mk7eTItv3/BxgMrQspHezCNa/h+6nPtj+ErqUcuudFif6KSCVSaVORhskuNjLFV9LdSt6SIQTeZTOWDYAdjZWcw==',key_name='tempest-TestMinimumBasicScenario-1543155359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-g7kat2qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:05Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=b8916557-afd1-4f26-af6f-36d4bf1637d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:07 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'pci_devices' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:43:08 user nova-compute[74441]:   <uuid>b8916557-afd1-4f26-af6f-36d4bf1637d5</uuid>
Nov 09 00:43:08 user nova-compute[74441]:   <name>instance-0000000b</name>
Nov 09 00:43:08 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:43:08 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:43:08 user nova-compute[74441]:   <metadata>
Nov 09 00:43:08 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:43:08 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:43:08 user nova-compute[74441]:       <nova:name>tempest-TestMinimumBasicScenario-server-1708721978</nova:name>
Nov 09 00:43:08 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:43:07</nova:creationTime>
Nov 09 00:43:08 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:43:08 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:43:08 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:43:08 user nova-compute[74441]:       <nova:owner>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:user uuid="5d2d3eb3c7104c9b8f1fd56fd44b8933">tempest-TestMinimumBasicScenario-1304250277-project-member</nova:user>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:project uuid="e6403e99121d4daba82abd58c7ecb708">tempest-TestMinimumBasicScenario-1304250277</nova:project>
Nov 09 00:43:08 user nova-compute[74441]:       </nova:owner>
Nov 09 00:43:08 user nova-compute[74441]:       <nova:root type="image" uuid="2c077062-0ceb-4a75-8d5b-5809f495e901"/>
Nov 09 00:43:08 user nova-compute[74441]:       <nova:ports>
Nov 09 00:43:08 user nova-compute[74441]:         <nova:port uuid="f5a83e73-e216-4a35-98a4-325c2bfabf6f">
Nov 09 00:43:08 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:43:08 user nova-compute[74441]:         </nova:port>
Nov 09 00:43:08 user nova-compute[74441]:       </nova:ports>
Nov 09 00:43:08 user nova-compute[74441]:     </nova:instance>
Nov 09 00:43:08 user nova-compute[74441]:   </metadata>
Nov 09 00:43:08 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:43:08 user nova-compute[74441]:     <system>
Nov 09 00:43:08 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:43:08 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:43:08 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:43:08 user nova-compute[74441]:       <entry name="serial">b8916557-afd1-4f26-af6f-36d4bf1637d5</entry>
Nov 09 00:43:08 user nova-compute[74441]:       <entry name="uuid">b8916557-afd1-4f26-af6f-36d4bf1637d5</entry>
Nov 09 00:43:08 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:43:08 user nova-compute[74441]:     </system>
Nov 09 00:43:08 user nova-compute[74441]:   </sysinfo>
Nov 09 00:43:08 user nova-compute[74441]:   <os>
Nov 09 00:43:08 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:43:08 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:43:08 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:43:08 user nova-compute[74441]:   </os>
Nov 09 00:43:08 user nova-compute[74441]:   <features>
Nov 09 00:43:08 user nova-compute[74441]:     <acpi/>
Nov 09 00:43:08 user nova-compute[74441]:     <apic/>
Nov 09 00:43:08 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:43:08 user nova-compute[74441]:   </features>
Nov 09 00:43:08 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:43:08 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:43:08 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:43:08 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:43:08 user nova-compute[74441]:   </clock>
Nov 09 00:43:08 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:43:08 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:43:08 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:43:08 user nova-compute[74441]:   </cpu>
Nov 09 00:43:08 user nova-compute[74441]:   <devices>
Nov 09 00:43:08 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:43:08 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:43:08 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk"/>
Nov 09 00:43:08 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:43:08 user nova-compute[74441]:     </disk>
Nov 09 00:43:08 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:43:08 user nova-compute[74441]:       <mac address="fa:16:3e:7d:49:fc"/>
Nov 09 00:43:08 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:43:08 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:43:08 user nova-compute[74441]:       <target dev="tapf5a83e73-e2"/>
Nov 09 00:43:08 user nova-compute[74441]:     </interface>
Nov 09 00:43:08 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:43:08 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/console.log" append="off"/>
Nov 09 00:43:08 user nova-compute[74441]:     </serial>
Nov 09 00:43:08 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:43:08 user nova-compute[74441]:     <video>
Nov 09 00:43:08 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:43:08 user nova-compute[74441]:     </video>
Nov 09 00:43:08 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:43:08 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:43:08 user nova-compute[74441]:     </rng>
Nov 09 00:43:08 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:43:08 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:43:08 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:43:08 user nova-compute[74441]:     </memballoon>
Nov 09 00:43:08 user nova-compute[74441]:   </devices>
Nov 09 00:43:08 user nova-compute[74441]: </domain>
Nov 09 00:43:08 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1708721978',display_name='tempest-TestMinimumBasicScenario-server-1708721978',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1708721978',id=11,image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1DyXAVVagm42WZaoBwEG/24CEZ37Beb75VSiZDVu4Mk7eTItv3/BxgMrQspHezCNa/h+6nPtj+ErqUcuudFif6KSCVSaVORhskuNjLFV9LdSt6SIQTeZTOWDYAdjZWcw==',key_name='tempest-TestMinimumBasicScenario-1543155359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-g7kat2qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:05Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=b8916557-afd1-4f26-af6f-36d4bf1637d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG os_vif [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d70f022-079d-5948-b9d4-31ff4db0a63f', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a83e73-e2, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5a83e73-e2, col_values=(('qos', UUID('debd5bd3-a9ec-4bfb-a833-951233d08b20')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5a83e73-e2, col_values=(('external_ids', {'iface-id': 'f5a83e73-e216-4a35-98a4-325c2bfabf6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:49:fc', 'vm-uuid': 'b8916557-afd1-4f26-af6f-36d4bf1637d5'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:08 user nova-compute[74441]: INFO os_vif [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2')
Nov 09 00:43:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:43:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No VIF found with MAC fa:16:3e:7d:49:fc, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5401c068-72a6-4361-a4f0-9f280d51d5e4 req-730599ca-0144-4f0d-9104-e1266c1b6dc8 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5401c068-72a6-4361-a4f0-9f280d51d5e4 req-730599ca-0144-4f0d-9104-e1266c1b6dc8 service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5401c068-72a6-4361-a4f0-9f280d51d5e4 req-730599ca-0144-4f0d-9104-e1266c1b6dc8 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5401c068-72a6-4361-a4f0-9f280d51d5e4 req-730599ca-0144-4f0d-9104-e1266c1b6dc8 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5401c068-72a6-4361-a4f0-9f280d51d5e4 req-730599ca-0144-4f0d-9104-e1266c1b6dc8 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:09 user nova-compute[74441]: WARNING nova.compute.manager [req-5401c068-72a6-4361-a4f0-9f280d51d5e4 req-730599ca-0144-4f0d-9104-e1266c1b6dc8 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state building and task_state spawning.
Nov 09 00:43:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-2ba37f48-8fb7-4e76-92cf-af5408fad44d req-a8ae6f17-536a-4c8a-926e-ff2b40423c4a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2ba37f48-8fb7-4e76-92cf-af5408fad44d req-a8ae6f17-536a-4c8a-926e-ff2b40423c4a service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2ba37f48-8fb7-4e76-92cf-af5408fad44d req-a8ae6f17-536a-4c8a-926e-ff2b40423c4a service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2ba37f48-8fb7-4e76-92cf-af5408fad44d req-a8ae6f17-536a-4c8a-926e-ff2b40423c4a service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-2ba37f48-8fb7-4e76-92cf-af5408fad44d req-a8ae6f17-536a-4c8a-926e-ff2b40423c4a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:11 user nova-compute[74441]: WARNING nova.compute.manager [req-2ba37f48-8fb7-4e76-92cf-af5408fad44d req-a8ae6f17-536a-4c8a-926e-ff2b40423c4a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state building and task_state spawning.
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:43:11 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance spawned successfully.
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:12 user nova-compute[74441]: INFO nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Took 6.69 seconds to spawn the instance on the hypervisor.
Nov 09 00:43:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:43:12 user nova-compute[74441]: INFO nova.compute.manager [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Took 7.44 seconds to build instance.
Nov 09 00:43:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f4b5ce7-80fb-414f-9964-b5ba5f15d87e tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.537s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:13 user nova-compute[74441]: INFO nova.compute.manager [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] [instance: 6e7a69cc-14e9-4a6f-b736-e74de84f8220] Took 9.87 seconds to detach 3 volumes for instance.
Nov 09 00:43:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:13 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:13 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:13 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Deleted allocations for instance 6e7a69cc-14e9-4a6f-b736-e74de84f8220
Nov 09 00:43:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f2a6b628-ef4b-4c24-b093-104af2ced9d3 tempest-TaggedBootDevicesTest-1058018725 tempest-TaggedBootDevicesTest-1058018725-project-member] Lock "6e7a69cc-14e9-4a6f-b736-e74de84f8220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.324s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:43:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:43:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:43:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:43:22 user nova-compute[74441]: INFO nova.compute.claims [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Claim successful on node user
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: INFO nova.compute.manager [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Terminating instance
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-35a54c84-e62a-4698-8d83-e976d2237b59 req-8eaa9e1d-b601-4eae-b4fb-beb8ca907927 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-unplugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-35a54c84-e62a-4698-8d83-e976d2237b59 req-8eaa9e1d-b601-4eae-b4fb-beb8ca907927 service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-35a54c84-e62a-4698-8d83-e976d2237b59 req-8eaa9e1d-b601-4eae-b4fb-beb8ca907927 service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-35a54c84-e62a-4698-8d83-e976d2237b59 req-8eaa9e1d-b601-4eae-b4fb-beb8ca907927 service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-35a54c84-e62a-4698-8d83-e976d2237b59 req-8eaa9e1d-b601-4eae-b4fb-beb8ca907927 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-unplugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-35a54c84-e62a-4698-8d83-e976d2237b59 req-8eaa9e1d-b601-4eae-b4fb-beb8ca907927 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-unplugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:43:22 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:43:22 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:43:23 user nova-compute[74441]: INFO nova.virt.block_device [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Booting with volume 7180e750-8d04-442f-9e73-d07278f76b8b at /dev/vda
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_brick.utils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91641952-3aef-4831-82a6-efea43f2fc3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[59706d5b-267d-40aa-93a9-81d027270298]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f7c299-0fdd-42d8-ac14-c4576ef88b57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82287e-c695-4cb7-a4a7-58e98706f3dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:43:23 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[053c9791-9eb4-497f-a099-fa1fca10d8e7]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_brick.utils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating existing volume attachment record: 1910236c-b7c6-4966-ae90-48d59961a04c {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.policy [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5600a163b7af47d6b59480bd54e0f4e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7674f3c6c6be458bab6baf5195da1f27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:43:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Instance destroyed successfully.
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lazy-loading 'resources' on Instance uuid f4bd46e4-44cb-4b47-9781-4adece881c74 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2143081500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2143081500',id=4,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkCCgC+eJUWLqVKq2e1R+vjlu7wY9fwA2ETuINPKMzHCKsVaAAZwdt0/BJl3MvA2ZbS+9cdPyZVdU46yvxXPdf2AZwuOeyW2Rz46Y1B/wcgbafAE7ORcTSCjKJlUleltw==',key_name='tempest-keypair-291657433',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ce510b60b4e444f930d32c5301698d6',ramdisk_id='',reservation_id='r-c77eg29e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-154539280',owner_user_name='tempest-TaggedAttachmentsTest-154539280-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adf38aba1dcf4d8e8cb89728ff19509b',uuid=f4bd46e4-44cb-4b47-9781-4adece881c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converting VIF {"id": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "address": "fa:16:3e:d3:4b:2d", "network": {"id": "d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1178461107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ce510b60b4e444f930d32c5301698d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap791979c2-d1", "ovs_interfaceid": "791979c2-d197-4cdf-9d7a-a0a895ce47c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG os_vif [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap791979c2-d1, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b0948bf-65ad-4da8-9dcb-1428c94f5d20) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:23 user nova-compute[74441]: INFO os_vif [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:4b:2d,bridge_name='br-int',has_traffic_filtering=True,id=791979c2-d197-4cdf-9d7a-a0a895ce47c6,network=Network(d2828f72-2dca-4eb6-a2fc-1fcc3acfbba5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap791979c2-d1')
Nov 09 00:43:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Deleting instance files /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74_del
Nov 09 00:43:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Deletion of /opt/stack/data/nova/instances/f4bd46e4-44cb-4b47-9781-4adece881c74_del complete
Nov 09 00:43:23 user nova-compute[74441]: INFO nova.compute.manager [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 09 00:43:23 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:43:23 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully created port: 438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:24 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Took 0.83 seconds to deallocate network for instance.
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-f61dcbc3-7b50-488a-9e29-ebaca7ff5244 req-48940480-c90d-44ba-8d3f-3ccbd25fec96 service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-deleted-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully created port: 4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:24 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Deleted allocations for instance f4bd46e4-44cb-4b47-9781-4adece881c74
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e5f53aa-da4e-4b67-b78c-8b6757928673 req-2d46cff2-c6c0-4d36-8d54-9fd266e2f4bf service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received event network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e5f53aa-da4e-4b67-b78c-8b6757928673 req-2d46cff2-c6c0-4d36-8d54-9fd266e2f4bf service nova] Acquiring lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e5f53aa-da4e-4b67-b78c-8b6757928673 req-2d46cff2-c6c0-4d36-8d54-9fd266e2f4bf service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e5f53aa-da4e-4b67-b78c-8b6757928673 req-2d46cff2-c6c0-4d36-8d54-9fd266e2f4bf service nova] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e5f53aa-da4e-4b67-b78c-8b6757928673 req-2d46cff2-c6c0-4d36-8d54-9fd266e2f4bf service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] No waiting events found dispatching network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:24 user nova-compute[74441]: WARNING nova.compute.manager [req-8e5f53aa-da4e-4b67-b78c-8b6757928673 req-2d46cff2-c6c0-4d36-8d54-9fd266e2f4bf service nova] [instance: f4bd46e4-44cb-4b47-9781-4adece881c74] Received unexpected event network-vif-plugged-791979c2-d197-4cdf-9d7a-a0a895ce47c6 for instance with vm_state deleted and task_state None.
Nov 09 00:43:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f6519f17-eaa7-4802-b3ff-7f8209035173 tempest-TaggedAttachmentsTest-154539280 tempest-TaggedAttachmentsTest-154539280-project-member] Lock "f4bd46e4-44cb-4b47-9781-4adece881c74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.429s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully created port: 127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:43:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully created port: 2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:43:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully created port: e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: 438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-438936fd-f9fa-4b7a-b34d-52c4ca8da721. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port 438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bbea0e26-cd35-4646-a31d-8d66adc10286 req-51fbd446-5ced-4029-bfff-a9654d9e4e66 service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: 7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: 4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-7a2f3f39-a5bb-4699-b744-dd695d1904cd. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port 7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:29 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-b0e68402-e24d-45e4-afac-b6e9a59ef02d. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-4f896c9d-ea07-468f-9f6a-94c6702c3de6. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port 4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: 127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG nova.network.neutron [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3799a5a1-01ce-4091-aa1f-2da24f84038e req-559e7772-ead0-4fb7-ba88-fbb00f0285b7 service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: 2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Successfully updated port: e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-127accf4-df28-4e47-991c-09a2571517be. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port 127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-2f74a5a7-b670-45f8-947e-b5da91660635. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port 2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-838102cb-964b-41b1-8404-45eac129fdaa req-db81bbc9-2d18-4d55-a389-d98f9f548aa9 service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:43:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-e1abb294-bcf6-4f45-a942-a35f4f19e6f7. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:43:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:43:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [{"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance network_info: |[{"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:43:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:43:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:43:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updated VIF entry in instance network info cache for port e1abb294-bcf6-4f45-a942-a35f4f19e6f7. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:43:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [{"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e07a4490-9ef5-4725-9c78-2ee8db277996 req-704d86b9-60a7-4078-ab9a-871883dd2cde service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:43:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEWBJXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:43:39 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:43:39 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:43:39 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4763dde2-e46a-46f4-a984-7e7113920a02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:43:39 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5158f-a28e-4b1c-a559-e044e2083512]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6] added
Nov 09 00:43:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a353e6e-9a18-40ad-a844-655acd668260]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c397a3a-2af5-442d-83f1-758b646f3c6d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEWBJXlK {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEWBJXlK" returned: 0 in 0.037s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ceac58-5009-4006-8565-6346434ed648]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GEWBJXlK'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[549cbb33-764f-4909-9218-25f991df3c47]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9a6de-ed02-4f03-9067-d489b25181f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:43:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Creating image(s)
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Ensure instance console log exists: /opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Start _get_guest_xml network_info=[{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffd43df5-7473-4cbf-aac1-52711f08e730', 'attached_at': '', 'detached_at': '', 'volume_id': '8540ef16-d3c0-427d-a8df-7e7eac6be287', 'serial': '8540ef16-d3c0-427d-a8df-7e7eac6be287'}, 'attachment_id': 'f4072198-46d4-4d8a-bfe0-dc35e73fc86a', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1811f8-7955-4704-a92c-46ff15fa612c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260]
Nov 09 00:43:39 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260] successful.
Nov 09 00:43:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 00:43:39 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.objects.instance [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lazy-loading 'vcpu_model' on Instance uuid ffd43df5-7473-4cbf-aac1-52711f08e730 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1be55f-da66-4414-ab45-b6355daa4aae]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:43:39 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a1280-d19b-4eea-a082-8fae6caec005]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:43:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[986cca0e-84db-469c-b7f9-d72cc0aace4a]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:43:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEWBJXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:40 user nova-compute[74441]: INFO nova.compute.manager [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Terminating instance
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:40 user nova-compute[74441]: INFO nova.compute.manager [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Terminating instance
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26531626632663966', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531626632663966', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.040s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:43:40 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:43:40 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.objects.instance [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'flavor' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f5880d-bdc5-467d-9564-57c07a5102ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:43:40 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:43:40 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:43:40 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:43:40 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 00:43:40 user nova-compute[74441]:   <serial>bf073ca8-8eff-4925-b0f1-ee9bdc6288a6</serial>
Nov 09 00:43:40 user nova-compute[74441]: </disk>
Nov 09 00:43:40 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b135d704-716b-4969-a248-77d89e8deaaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287] added
Nov 09 00:43:40 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f3fefc-786b-48c4-a881-e5fbe9d9fc19]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2a0fb3-b9c4-4a02-909f-c89591f14e03]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZGaDVcB {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZGaDVcB" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d27183-05f6-46c2-aacf-a28522ca8010]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZGaDVcB'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5862f-f10c-409b-b642-0fade388589f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a521e54-2e32-444f-a076-014e63a858a4 req-ec7f2c1b-91f1-4a8d-961a-3043863d7f17 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-vif-unplugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a521e54-2e32-444f-a076-014e63a858a4 req-ec7f2c1b-91f1-4a8d-961a-3043863d7f17 service nova] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a521e54-2e32-444f-a076-014e63a858a4 req-ec7f2c1b-91f1-4a8d-961a-3043863d7f17 service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a521e54-2e32-444f-a076-014e63a858a4 req-ec7f2c1b-91f1-4a8d-961a-3043863d7f17 service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a521e54-2e32-444f-a076-014e63a858a4 req-ec7f2c1b-91f1-4a8d-961a-3043863d7f17 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] No waiting events found dispatching network-vif-unplugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a521e54-2e32-444f-a076-014e63a858a4 req-ec7f2c1b-91f1-4a8d-961a-3043863d7f17 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-vif-unplugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[07521081-d296-4e95-9ddc-f758bf179af5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:40 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:40 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:43:40 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:40 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:40 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:43:40 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:43:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c045b8-ef9c-4ac1-bcd8-16eca3f6866e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]
Nov 09 00:43:41 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.
Nov 09 00:43:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab703f-0942-411d-9cd1-8ed2992bfd30]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d577103-331e-4ef5-9540-bdbd7a6aa258]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:43:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3ac9b5-2b96-4ca2-ae5f-05abbf99a84d]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Instance destroyed successfully.
Nov 09 00:43:41 user nova-compute[74441]: DEBUG nova.objects.instance [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lazy-loading 'resources' on Instance uuid a35832ac-1910-4496-b14e-fcb99b973e41 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-679113036',display_name='tempest-TestVolumeSwap-server-679113036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-679113036',id=5,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHgfL0mHcq1gx7SFm05ZgDvixwR9YiFpisQ8J/lVNa7MpgDaXe0w6omfOkFK4UoGtkLGxlEMm6+JfEQXsT2pXOd5byIZ7cmbqwuxUA/kbIlMqIl86vSc1FZ8J9Xtl542A==',key_name='tempest-keypair-1643188880',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d14ace0cb8b4ecfb0c1e76ba72480b6',ramdisk_id='',reservation_id='r-4al1hrq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1457783965',owner_user_name='tempest-TestVolumeSwap-1457783965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca814243b0354c32bb5ed201bf8891d7',uuid=a35832ac-1910-4496-b14e-fcb99b973e41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Converting VIF {"id": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "address": "fa:16:3e:9d:74:53", "network": {"id": "68a61f5a-a641-44f1-94e7-59567f057945", "bridge": "br-int", "label": "tempest-TestVolumeSwap-494429497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d14ace0cb8b4ecfb0c1e76ba72480b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfde83601-62", "ovs_interfaceid": "fde83601-62cf-49dc-bbbc-5354f20e0ef0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG os_vif [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfde83601-62, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ef8e1dc-1b4c-426a-a3c2-c4a38064d20c) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: INFO os_vif [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:74:53,bridge_name='br-int',has_traffic_filtering=True,id=fde83601-62cf-49dc-bbbc-5354f20e0ef0,network=Network(68a61f5a-a641-44f1-94e7-59567f057945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfde83601-62')
Nov 09 00:43:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Deleting instance files /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41_del
Nov 09 00:43:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Deletion of /opt/stack/data/nova/instances/a35832ac-1910-4496-b14e-fcb99b973e41_del complete
Nov 09 00:43:41 user nova-compute[74441]: INFO nova.compute.manager [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 09 00:43:41 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Instance destroyed successfully.
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lazy-loading 'resources' on Instance uuid 265471cf-50b2-4759-a485-fa5e2a4e50a8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:38:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-993205133',display_name='tempest-AttachSCSIVolumeTestJSON-server-993205133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-993205133',id=3,image_ref='1a821288-e3cf-46a9-b5db-b9d7aa277f55',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGv/1T5kLyb3FkT6vsbkvYRp+BoU176fi8y0BhaQl5GN6e9WedPubA3+iURa1rUkOVq1gaAvbwBzfX4vtmkKSGm+UxWY1HC5IsWe905T0JYEoypHANkdRzuNYj3m1EnbA==',key_name='tempest-keypair-217887964',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:38:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13d11ffa9f74456ea45d00a6b6f32260',ramdisk_id='',reservation_id='r-x60e49vq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1a821288-e3cf-46a9-b5db-b9d7aa277f55',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1980231610',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1980231610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a995fb8a8049e881b6ca3818eca0eb',uuid=265471cf-50b2-4759-a485-fa5e2a4e50a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Converting VIF {"id": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "address": "fa:16:3e:00:b0:33", "network": {"id": "65549b03-e5d9-4067-83b7-b362d840d5dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1631198380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13d11ffa9f74456ea45d00a6b6f32260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0c3a06-c4", "ovs_interfaceid": "3a0c3a06-c493-4f7a-8f30-961e9f20389c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG os_vif [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a0c3a06-c4, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25645d13-1ba1-4676-8686-0bb8f216c1a0) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: INFO os_vif [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:b0:33,bridge_name='br-int',has_traffic_filtering=True,id=3a0c3a06-c493-4f7a-8f30-961e9f20389c,network=Network(65549b03-e5d9-4067-83b7-b362d840d5dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a0c3a06-c4')
Nov 09 00:43:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Deleting instance files /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8_del
Nov 09 00:43:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Deletion of /opt/stack/data/nova/instances/265471cf-50b2-4759-a485-fa5e2a4e50a8_del complete
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] No VIF found with MAC fa:16:3e:9a:b8:71, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:43:42 user nova-compute[74441]: INFO nova.compute.manager [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== connect_volume: return (2465ms) {'type': 'block', 'scsi_wwn': '26334393934663061', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334393934663061', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1328300774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-131231847',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhNlCCZx6xii87AgroIHY4kUCQ+iFfYCnreRdGg2szTS8Xh+BOox5k6rsoS0vhTFKUMZFNqmluqNwT9TNCdC/4eRnP5Yt+l1XOe9CLT13M16/eqOS1scP3PQJ8uNIYBtw==',key_name='tempest-keypair-957284537',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b473302f384e4279a9d098c44eb31e96',ramdisk_id='',reservation_id='r-cswotsek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-302690474',owner_user_name='tempest-ServerActionsV293TestJSON-302690474-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1bc19273fa047e7bec957c05a6f0e4a',uuid=ffd43df5-7473-4cbf-aac1-52711f08e730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converting VIF {"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:43:42 user nova-compute[74441]:   <uuid>ffd43df5-7473-4cbf-aac1-52711f08e730</uuid>
Nov 09 00:43:42 user nova-compute[74441]:   <name>instance-00000008</name>
Nov 09 00:43:42 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:43:42 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:43:42 user nova-compute[74441]:   <metadata>
Nov 09 00:43:42 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:43:42 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:43:42 user nova-compute[74441]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1328300774</nova:name>
Nov 09 00:43:42 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:43:39</nova:creationTime>
Nov 09 00:43:42 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:43:42 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:43:42 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:43:42 user nova-compute[74441]:       <nova:owner>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:user uuid="b1bc19273fa047e7bec957c05a6f0e4a">tempest-ServerActionsV293TestJSON-302690474-project-member</nova:user>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:project uuid="b473302f384e4279a9d098c44eb31e96">tempest-ServerActionsV293TestJSON-302690474</nova:project>
Nov 09 00:43:42 user nova-compute[74441]:       </nova:owner>
Nov 09 00:43:42 user nova-compute[74441]:       <nova:ports>
Nov 09 00:43:42 user nova-compute[74441]:         <nova:port uuid="00d12234-ef41-4e58-a03a-4180752d7d2f">
Nov 09 00:43:42 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 00:43:42 user nova-compute[74441]:         </nova:port>
Nov 09 00:43:42 user nova-compute[74441]:       </nova:ports>
Nov 09 00:43:42 user nova-compute[74441]:     </nova:instance>
Nov 09 00:43:42 user nova-compute[74441]:   </metadata>
Nov 09 00:43:42 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:43:42 user nova-compute[74441]:     <system>
Nov 09 00:43:42 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:43:42 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:43:42 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:43:42 user nova-compute[74441]:       <entry name="serial">ffd43df5-7473-4cbf-aac1-52711f08e730</entry>
Nov 09 00:43:42 user nova-compute[74441]:       <entry name="uuid">ffd43df5-7473-4cbf-aac1-52711f08e730</entry>
Nov 09 00:43:42 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:43:42 user nova-compute[74441]:     </system>
Nov 09 00:43:42 user nova-compute[74441]:   </sysinfo>
Nov 09 00:43:42 user nova-compute[74441]:   <os>
Nov 09 00:43:42 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:43:42 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:43:42 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:43:42 user nova-compute[74441]:   </os>
Nov 09 00:43:42 user nova-compute[74441]:   <features>
Nov 09 00:43:42 user nova-compute[74441]:     <acpi/>
Nov 09 00:43:42 user nova-compute[74441]:     <apic/>
Nov 09 00:43:42 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:43:42 user nova-compute[74441]:   </features>
Nov 09 00:43:42 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:43:42 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:43:42 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:43:42 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:43:42 user nova-compute[74441]:   </clock>
Nov 09 00:43:42 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:43:42 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:43:42 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:43:42 user nova-compute[74441]:   </cpu>
Nov 09 00:43:42 user nova-compute[74441]:   <devices>
Nov 09 00:43:42 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:43:42 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:43:42 user nova-compute[74441]:       <source dev="/dev/sdd"/>
Nov 09 00:43:42 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:43:42 user nova-compute[74441]:       <serial>8540ef16-d3c0-427d-a8df-7e7eac6be287</serial>
Nov 09 00:43:42 user nova-compute[74441]:     </disk>
Nov 09 00:43:42 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:43:42 user nova-compute[74441]:       <mac address="fa:16:3e:9e:05:04"/>
Nov 09 00:43:42 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:43:42 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:43:42 user nova-compute[74441]:       <target dev="tap00d12234-ef"/>
Nov 09 00:43:42 user nova-compute[74441]:     </interface>
Nov 09 00:43:42 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:43:42 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730/console.log" append="off"/>
Nov 09 00:43:42 user nova-compute[74441]:     </serial>
Nov 09 00:43:42 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:43:42 user nova-compute[74441]:     <video>
Nov 09 00:43:42 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:43:42 user nova-compute[74441]:     </video>
Nov 09 00:43:42 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:43:42 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:43:42 user nova-compute[74441]:     </rng>
Nov 09 00:43:42 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:43:42 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:43:42 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:43:42 user nova-compute[74441]:     </memballoon>
Nov 09 00:43:42 user nova-compute[74441]:   </devices>
Nov 09 00:43:42 user nova-compute[74441]: </domain>
Nov 09 00:43:42 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1328300774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-131231847',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhNlCCZx6xii87AgroIHY4kUCQ+iFfYCnreRdGg2szTS8Xh+BOox5k6rsoS0vhTFKUMZFNqmluqNwT9TNCdC/4eRnP5Yt+l1XOe9CLT13M16/eqOS1scP3PQJ8uNIYBtw==',key_name='tempest-keypair-957284537',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:40:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b473302f384e4279a9d098c44eb31e96',ramdisk_id='',reservation_id='r-cswotsek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-302690474',owner_user_name='tempest-ServerActionsV293TestJSON-302690474-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1bc19273fa047e7bec957c05a6f0e4a',uuid=ffd43df5-7473-4cbf-aac1-52711f08e730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converting VIF {"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG os_vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0263af1e-56db-561c-bce3-4684bf9d48a5', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00d12234-ef, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00d12234-ef, col_values=(('qos', UUID('d0e4c7b9-54a4-42f1-b9f4-6a03d401e283')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00d12234-ef, col_values=(('external_ids', {'iface-id': '00d12234-ef41-4e58-a03a-4180752d7d2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:05:04', 'vm-uuid': 'ffd43df5-7473-4cbf-aac1-52711f08e730'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: INFO os_vif [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef')
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-610b296b-7125-4473-9ab2-8ca2f3988ec6 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 68.398s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] No VIF found with MAC fa:16:3e:9e:05:04, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:42 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Took 1.01 seconds to deallocate network for instance.
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Acquiring lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Lock "a35832ac-1910-4496-b14e-fcb99b973e41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] No waiting events found dispatching network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:42 user nova-compute[74441]: WARNING nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received unexpected event network-vif-plugged-fde83601-62cf-49dc-bbbc-5354f20e0ef0 for instance with vm_state active and task_state deleting.
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-vif-unplugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] No waiting events found dispatching network-vif-unplugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-vif-unplugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Acquiring lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] No waiting events found dispatching network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:43 user nova-compute[74441]: WARNING nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received unexpected event network-vif-plugged-3a0c3a06-c493-4f7a-8f30-961e9f20389c for instance with vm_state active and task_state deleting.
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-f74dd77a-fed9-4360-8ce1-3b4195a61b54 req-879df31e-2d24-4bda-97a7-917fd93c4663 service nova] [instance: a35832ac-1910-4496-b14e-fcb99b973e41] Received event network-vif-deleted-fde83601-62cf-49dc-bbbc-5354f20e0ef0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:43 user nova-compute[74441]: INFO nova.compute.manager [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Detaching volume bf073ca8-8eff-4925-b0f1-ee9bdc6288a6
Nov 09 00:43:43 user nova-compute[74441]: INFO nova.virt.block_device [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attempting to driver detach volume bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 from mountpoint /dev/vdc
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Attempting to detach device vdc from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:43:43 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:43:43 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:43:43 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 00:43:43 user nova-compute[74441]:   <serial>bf073ca8-8eff-4925-b0f1-ee9bdc6288a6</serial>
Nov 09 00:43:43 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 00:43:43 user nova-compute[74441]: </disk>
Nov 09 00:43:43 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Successfully detached device vdc from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the persistent domain config.
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:43:43 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:43:43 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:43:43 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 00:43:43 user nova-compute[74441]:   <serial>bf073ca8-8eff-4925-b0f1-ee9bdc6288a6</serial>
Nov 09 00:43:43 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 00:43:43 user nova-compute[74441]: </disk>
Nov 09 00:43:43 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:43 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Deleted allocations for instance a35832ac-1910-4496-b14e-fcb99b973e41
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:43:43 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Took 1.31 seconds to deallocate network for instance.
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-3b879893-fd3c-4632-a7b6-b94ce7c6d464 req-c914129b-6a1b-46b7-8114-9bbc31c503cb service nova] [instance: 265471cf-50b2-4759-a485-fa5e2a4e50a8] Received event network-vif-deleted-3a0c3a06-c493-4f7a-8f30-961e9f20389c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-026b0f59-a057-4caa-b9b7-ebbce6e52127 tempest-TestVolumeSwap-1457783965 tempest-TestVolumeSwap-1457783965-project-member] Lock "a35832ac-1910-4496-b14e-fcb99b973e41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.890s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:43:43 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Deleted allocations for instance 265471cf-50b2-4759-a485-fa5e2a4e50a8
Nov 09 00:43:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c627222-c73e-4ba6-b249-95d6d19e3686 tempest-AttachSCSIVolumeTestJSON-1980231610 tempest-AttachSCSIVolumeTestJSON-1980231610-project-member] Lock "265471cf-50b2-4759-a485-fa5e2a4e50a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.401s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-d743f999-380c-42e2-bb93-dce8ba20eb97 req-e778518d-a8a6-4c8f-8360-bc0af5b76d09 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d743f999-380c-42e2-bb93-dce8ba20eb97 req-e778518d-a8a6-4c8f-8360-bc0af5b76d09 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d743f999-380c-42e2-bb93-dce8ba20eb97 req-e778518d-a8a6-4c8f-8360-bc0af5b76d09 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d743f999-380c-42e2-bb93-dce8ba20eb97 req-e778518d-a8a6-4c8f-8360-bc0af5b76d09 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-d743f999-380c-42e2-bb93-dce8ba20eb97 req-e778518d-a8a6-4c8f-8360-bc0af5b76d09 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:44 user nova-compute[74441]: WARNING nova.compute.manager [req-d743f999-380c-42e2-bb93-dce8ba20eb97 req-e778518d-a8a6-4c8f-8360-bc0af5b76d09 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state rebuild_spawning.
Nov 09 00:43:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:43:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:43:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance spawned successfully.
Nov 09 00:43:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-00200a93-2f91-44cf-a3f8-73f471a6cd9d req-59cef48f-7113-4bc1-9438-1332c7316e4b service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00200a93-2f91-44cf-a3f8-73f471a6cd9d req-59cef48f-7113-4bc1-9438-1332c7316e4b service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00200a93-2f91-44cf-a3f8-73f471a6cd9d req-59cef48f-7113-4bc1-9438-1332c7316e4b service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00200a93-2f91-44cf-a3f8-73f471a6cd9d req-59cef48f-7113-4bc1-9438-1332c7316e4b service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-00200a93-2f91-44cf-a3f8-73f471a6cd9d req-59cef48f-7113-4bc1-9438-1332c7316e4b service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:43:46 user nova-compute[74441]: WARNING nova.compute.manager [req-00200a93-2f91-44cf-a3f8-73f471a6cd9d req-59cef48f-7113-4bc1-9438-1332c7316e4b service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state rebuild_spawning.
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG nova.objects.instance [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74441) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 09 00:43:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06c1ecca-ca87-49fb-aced-bd9b349d76c6 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:47 user nova-compute[74441]: INFO nova.compute.manager [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Detaching volume ba6803b0-0980-4c35-b7aa-3e0a516ddbc8
Nov 09 00:43:47 user nova-compute[74441]: INFO nova.virt.block_device [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Attempting to driver detach volume ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 from mountpoint /dev/vdc
Nov 09 00:43:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Attempting to detach device vdc from instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:43:47 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:43:47 user nova-compute[74441]:   <source dev="/dev/sdg"/>
Nov 09 00:43:47 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 00:43:47 user nova-compute[74441]:   <serial>ba6803b0-0980-4c35-b7aa-3e0a516ddbc8</serial>
Nov 09 00:43:47 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 00:43:47 user nova-compute[74441]: </disk>
Nov 09 00:43:47 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:43:47 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully detached device vdc from instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc from the persistent domain config.
Nov 09 00:43:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:43:47 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:43:47 user nova-compute[74441]:   <source dev="/dev/sdg"/>
Nov 09 00:43:47 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 00:43:47 user nova-compute[74441]:   <serial>ba6803b0-0980-4c35-b7aa-3e0a516ddbc8</serial>
Nov 09 00:43:47 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 00:43:47 user nova-compute[74441]: </disk>
Nov 09 00:43:47 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:43:48 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:49 user nova-compute[74441]: INFO nova.virt.block_device [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Booting with volume ff0fbada-4331-4d52-8e14-2eac745a702a at /dev/vdb
Nov 09 00:43:49 user nova-compute[74441]: DEBUG os_brick.utils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152af01-2b96-4037-88bf-8634b656577a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c689c39c-902c-45f0-a951-50cf5243542f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dece0d-a2b6-4fb2-ae4f-5f579f1e63da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e9e5a-b9c9-4a3a-bc19-6b789dde2777]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:43:49 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:43:49 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0235140b-c625-4af9-b469-d1abc6024102]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG os_brick.utils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:43:49 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating existing volume attachment record: 40ad960c-b54f-496f-9383-e5e2e7ab5b2a {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:43:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:43:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:43:52 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:43:52 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=25.389400482177734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ffd43df5-7473-4cbf-aac1-52711f08e730 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 772ff868-f9c9-4cbf-a100-c57b3f5de48b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:43:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:43:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:03 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 is timed out.
Nov 09 00:44:03 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Successfully detached device vdc from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the live domain config.
Nov 09 00:44:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEWBJXlK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:44:03 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[572d907b-0d92-422c-983e-c518f7b8505a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:44:03 user nova-compute[74441]: No targets found.
Nov 09 00:44:03 user nova-compute[74441]: iSNS:
Nov 09 00:44:03 user nova-compute[74441]: No targets found.
Nov 09 00:44:03 user nova-compute[74441]: STATIC:
Nov 09 00:44:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8
Nov 09 00:44:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:44:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287
Nov 09 00:44:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:03 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6
Nov 09 00:44:03 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:03 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:03 user nova-compute[74441]: FIRMWARE:
Nov 09 00:44:03 user nova-compute[74441]: No targets found.
Nov 09 00:44:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:44:03 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:44:03 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4636ded8-fadc-408e-8963-05359f4f2041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2077c851-e103-411b-b977-8f71856f250d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:03 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c628f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:44:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb2bcda-ec15-4f9d-89b1-620ea4a9f9c4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb2eb93-a1b0-4a29-abf1-2898b65e370f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec81d93-6dce-4bd6-914c-65d7d8094944]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f7fba2-bfa7-4d9f-bb7a-1675b12e8eca]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ca7c3-0134-44a9-8be9-a58681a92eed]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44cb4fa-c709-46f9-b825-5879b3930092]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260]
Nov 09 00:44:04 user nova-compute[74441]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6, portal: 172.16.0.220,3260] successful.
Nov 09 00:44:04 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf073ca8-8eff-4925-b0f1-ee9bdc6288a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410331f-4e48-42d9-9fda-e8ff5135fcf7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] <== disconnect_volume: return (343ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:44:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:44:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'flavor' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c46be07-3738-4d84-8267-5e1a3cfa7b0f tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.165s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:07 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc is timed out.
Nov 09 00:44:07 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully detached device vdc from instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc from the live domain config.
Nov 09 00:44:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKlOgiMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:44:07 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:44:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54175de-6813-4247-a1e4-ef5faae52576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:44:07 user nova-compute[74441]: No targets found.
Nov 09 00:44:07 user nova-compute[74441]: iSNS:
Nov 09 00:44:07 user nova-compute[74441]: No targets found.
Nov 09 00:44:07 user nova-compute[74441]: STATIC:
Nov 09 00:44:07 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8
Nov 09 00:44:07 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:07 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:07 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:44:07 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:07 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:07 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287
Nov 09 00:44:07 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:07 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:07 user nova-compute[74441]: FIRMWARE:
Nov 09 00:44:07 user nova-compute[74441]: No targets found.
Nov 09 00:44:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:44:07 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:44:07 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:44:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d1f750-0ee2-4460-b035-33d562d50aab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a7bf3f-fb03-4e49-a2a6-aab004075ac4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:08 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:44:08 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:08 user nova-compute[74441]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 (non-flash)
Nov 09 00:44:08 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c53a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8'): ({'sdg'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Removing single pathed devices sdg {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[247b9d6b-cbf8-44d1-8238-f87a7e450c09]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc69c8e-8b24-4685-a1c0-eea486316f0f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flushing IO for device /dev/sdg {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[36400519-1312-4556-8deb-644ff532675e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc30446-35fe-4760-9c63-c17c91416d93]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] SCSI volumes sdg have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49f8ab-cd8d-4dec-a851-432853bc2485]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc2f7c1-65d7-4339-a92b-d2de67d41108]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260]
Nov 09 00:44:08 user nova-compute[74441]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8, portal: 172.16.0.220,3260] successful.
Nov 09 00:44:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba6803b0-0980-4c35-b7aa-3e0a516ddbc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d0eff-794a-4187-829c-468c583a88e7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] <== disconnect_volume: return (347ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:44:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:44:09 user nova-compute[74441]: DEBUG nova.objects.instance [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'flavor' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b365df0-139b-4a4c-b604-f06c84a352ec tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.059s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:44:23 user nova-compute[74441]: INFO nova.compute.claims [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Claim successful on node user
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.network.neutron [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:44:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.policy [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '197592c74bf14d389b65648dffd05aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe955c4cc64babb766d9c302cbcc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:44:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Creating image(s)
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "/opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "/opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.168s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.270s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk 1073741824" returned: 0 in 0.315s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.591s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG nova.network.neutron [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Successfully created port: 5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.266s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:44:25 user nova-compute[74441]: INFO nova.compute.claims [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Claim successful on node user
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Cannot resize image /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Ensure instance console log exists: /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:44:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Successfully updated port: 5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquired lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-changed-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Refreshing instance network info cache due to event network-changed-5afd2159-15d0-410e-9778-eb2b0c3c962c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] Acquiring lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:25 user nova-compute[74441]: INFO nova.virt.block_device [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Booting with volume 9d1bdad4-636f-45d3-bde5-7276ef7ada6c at /dev/vda
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.policy [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '714111389c1c4641b4461a684981ad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759f5f84856747d988ba0d33fe456f4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG os_brick.utils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa41df9f-657e-45c2-9d61-7d3039a0b537]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca226fa-c979-455b-b264-d578d11881ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f567fa1d-678d-4659-8bfe-c9f41a9e0ab5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e136e4-c2fb-44da-94f1-a10cabeb74da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:44:25 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ee0098-21ad-4412-a9e7-707dcf8f0c14]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG os_brick.utils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating existing volume attachment record: 359604d1-ac1d-4dc2-9dfb-bddd70f8c702 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating instance_info_cache with network_info: [{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Releasing lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Instance network_info: |[{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] Acquired lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Refreshing network info cache for port 5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Start _get_guest_xml network_info=[{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:44:25 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:25 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:44:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1183103633',display_name='tempest-VolumesAdminNegativeTest-server-1183103633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1183103633',id=13,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAv1zAuray+X/VAMIJqG06gqK4ibDBT3+rtLtgReSUofo5ybQSUELyoU/UYkeAcBdfCSUyRDWA0w5q8d//npvsqLr+neGIq5TBWCc72YY8dmKhEmPugHSAQCxnaqt8LSg==',key_name='tempest-keypair-1338366946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09fe955c4cc64babb766d9c302cbcc9f',ramdisk_id='',reservation_id='r-cxxz9pfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-676102726',owner_user_name='tempest-VolumesAdminNegativeTest-676102726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='197592c74bf14d389b65648dffd05aa6',uuid=cc9f8946-b092-417e-80b8-0f96b1e7912a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converting VIF {"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.objects.instance [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'pci_devices' on Instance uuid cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:44:26 user nova-compute[74441]:   <uuid>cc9f8946-b092-417e-80b8-0f96b1e7912a</uuid>
Nov 09 00:44:26 user nova-compute[74441]:   <name>instance-0000000d</name>
Nov 09 00:44:26 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:44:26 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:44:26 user nova-compute[74441]:   <metadata>
Nov 09 00:44:26 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:44:26 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:44:26 user nova-compute[74441]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1183103633</nova:name>
Nov 09 00:44:26 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:44:25</nova:creationTime>
Nov 09 00:44:26 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:44:26 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:44:26 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:44:26 user nova-compute[74441]:       <nova:owner>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:user uuid="197592c74bf14d389b65648dffd05aa6">tempest-VolumesAdminNegativeTest-676102726-project-member</nova:user>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:project uuid="09fe955c4cc64babb766d9c302cbcc9f">tempest-VolumesAdminNegativeTest-676102726</nova:project>
Nov 09 00:44:26 user nova-compute[74441]:       </nova:owner>
Nov 09 00:44:26 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:44:26 user nova-compute[74441]:       <nova:ports>
Nov 09 00:44:26 user nova-compute[74441]:         <nova:port uuid="5afd2159-15d0-410e-9778-eb2b0c3c962c">
Nov 09 00:44:26 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:44:26 user nova-compute[74441]:         </nova:port>
Nov 09 00:44:26 user nova-compute[74441]:       </nova:ports>
Nov 09 00:44:26 user nova-compute[74441]:     </nova:instance>
Nov 09 00:44:26 user nova-compute[74441]:   </metadata>
Nov 09 00:44:26 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:44:26 user nova-compute[74441]:     <system>
Nov 09 00:44:26 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:44:26 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:44:26 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:44:26 user nova-compute[74441]:       <entry name="serial">cc9f8946-b092-417e-80b8-0f96b1e7912a</entry>
Nov 09 00:44:26 user nova-compute[74441]:       <entry name="uuid">cc9f8946-b092-417e-80b8-0f96b1e7912a</entry>
Nov 09 00:44:26 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:44:26 user nova-compute[74441]:     </system>
Nov 09 00:44:26 user nova-compute[74441]:   </sysinfo>
Nov 09 00:44:26 user nova-compute[74441]:   <os>
Nov 09 00:44:26 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:44:26 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:44:26 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:44:26 user nova-compute[74441]:   </os>
Nov 09 00:44:26 user nova-compute[74441]:   <features>
Nov 09 00:44:26 user nova-compute[74441]:     <acpi/>
Nov 09 00:44:26 user nova-compute[74441]:     <apic/>
Nov 09 00:44:26 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:44:26 user nova-compute[74441]:   </features>
Nov 09 00:44:26 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:44:26 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:44:26 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:44:26 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:44:26 user nova-compute[74441]:   </clock>
Nov 09 00:44:26 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:44:26 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:44:26 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:44:26 user nova-compute[74441]:   </cpu>
Nov 09 00:44:26 user nova-compute[74441]:   <devices>
Nov 09 00:44:26 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:44:26 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:44:26 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk"/>
Nov 09 00:44:26 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:44:26 user nova-compute[74441]:     </disk>
Nov 09 00:44:26 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:44:26 user nova-compute[74441]:       <mac address="fa:16:3e:eb:a7:16"/>
Nov 09 00:44:26 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:26 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:44:26 user nova-compute[74441]:       <target dev="tap5afd2159-15"/>
Nov 09 00:44:26 user nova-compute[74441]:     </interface>
Nov 09 00:44:26 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:44:26 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/console.log" append="off"/>
Nov 09 00:44:26 user nova-compute[74441]:     </serial>
Nov 09 00:44:26 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:44:26 user nova-compute[74441]:     <video>
Nov 09 00:44:26 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:26 user nova-compute[74441]:     </video>
Nov 09 00:44:26 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:44:26 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:44:26 user nova-compute[74441]:     </rng>
Nov 09 00:44:26 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:44:26 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:44:26 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:44:26 user nova-compute[74441]:     </memballoon>
Nov 09 00:44:26 user nova-compute[74441]:   </devices>
Nov 09 00:44:26 user nova-compute[74441]: </domain>
Nov 09 00:44:26 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1183103633',display_name='tempest-VolumesAdminNegativeTest-server-1183103633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1183103633',id=13,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAv1zAuray+X/VAMIJqG06gqK4ibDBT3+rtLtgReSUofo5ybQSUELyoU/UYkeAcBdfCSUyRDWA0w5q8d//npvsqLr+neGIq5TBWCc72YY8dmKhEmPugHSAQCxnaqt8LSg==',key_name='tempest-keypair-1338366946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09fe955c4cc64babb766d9c302cbcc9f',ramdisk_id='',reservation_id='r-cxxz9pfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-676102726',owner_user_name='tempest-VolumesAdminNegativeTest-676102726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='197592c74bf14d389b65648dffd05aa6',uuid=cc9f8946-b092-417e-80b8-0f96b1e7912a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converting VIF {"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG os_vif [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e48a80a-287d-5b82-b6b6-de9d160e6ae0', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5afd2159-15, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5afd2159-15, col_values=(('qos', UUID('23541a25-ff45-458f-a021-f1a3121fd2fe')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5afd2159-15, col_values=(('external_ids', {'iface-id': '5afd2159-15d0-410e-9778-eb2b0c3c962c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:a7:16', 'vm-uuid': 'cc9f8946-b092-417e-80b8-0f96b1e7912a'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:26 user nova-compute[74441]: INFO os_vif [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15')
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No VIF found with MAC fa:16:3e:eb:a7:16, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Successfully created port: 84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.neutron [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updated VIF entry in instance network info cache for port 5afd2159-15d0-410e-9778-eb2b0c3c962c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG nova.network.neutron [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating instance_info_cache with network_info: [{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-12085cf5-04ef-49e8-9064-bc529f2c0d71 req-9977afd9-6b42-46f3-a8b0-181d9b82152e service nova] Releasing lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Successfully updated port: 84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquired lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-changed-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Refreshing instance network info cache due to event network-changed-84b58c57-9620-47d6-80c3-af900e6db54a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] Acquiring lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating instance_info_cache with network_info: [{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Releasing lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance network_info: |[{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] Acquired lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Refreshing network info cache for port 84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:44:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updated VIF entry in instance network info cache for port 84b58c57-9620-47d6-80c3-af900e6db54a. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:44:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating instance_info_cache with network_info: [{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a30097e7-9d49-4e87-b69f-86fc5b263fb9 req-5c7fba8f-b0c5-4da7-9138-484338d9cbca service nova] Releasing lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:29 user nova-compute[74441]: INFO nova.virt.block_device [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Booting with volume 6d420062-7515-4f85-929e-46746d11cfcf at /dev/vdc
Nov 09 00:44:29 user nova-compute[74441]: DEBUG os_brick.utils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[50862b93-6c38-4768-baed-4269bb4e52fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d580c523-2884-45a4-bb41-1bc42a2f3973]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] No waiting events found dispatching network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:29 user nova-compute[74441]: WARNING nova.compute.manager [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received unexpected event network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c for instance with vm_state building and task_state spawning.
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] No waiting events found dispatching network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:29 user nova-compute[74441]: WARNING nova.compute.manager [req-d9a92cf5-40e5-47d6-97e5-f181488184f8 req-ce9e9a0b-9e73-4d9a-ba00-4d1b7cdc741d service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received unexpected event network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c for instance with vm_state building and task_state spawning.
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[778638c5-3a79-4498-b23e-60f28a007bf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[29961e73-32f3-48ae-b934-3623eecacdb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:44:29 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:44:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1fccb5-6e59-4b88-82b6-096da52306fb]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG os_brick.utils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating existing volume attachment record: 0a690b9b-0599-482c-8ae5-e4a71147e359 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:44:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Instance spawned successfully.
Nov 09 00:44:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:30 user nova-compute[74441]: INFO nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 09 00:44:30 user nova-compute[74441]: DEBUG nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:44:30 user nova-compute[74441]: INFO nova.compute.manager [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Took 6.83 seconds to build instance.
Nov 09 00:44:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-20d74852-8bd4-4973-8d9a-d7f16f4b885f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.930s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:33 user nova-compute[74441]: INFO nova.compute.manager [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Detaching volume ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:44:34 user nova-compute[74441]: INFO nova.virt.block_device [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Attempting to driver detach volume ce983810-1854-4cf1-8f5c-4ea7af02fd98 from mountpoint /dev/vdb
Nov 09 00:44:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Attempting to detach device vdb from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:44:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:44:34 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:44:34 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:44:34 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:44:34 user nova-compute[74441]:   <serial>ce983810-1854-4cf1-8f5c-4ea7af02fd98</serial>
Nov 09 00:44:34 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:44:34 user nova-compute[74441]: </disk>
Nov 09 00:44:34 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:44:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Successfully detached device vdb from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the persistent domain config.
Nov 09 00:44:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:44:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:44:34 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:44:34 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:44:34 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:44:34 user nova-compute[74441]:   <serial>ce983810-1854-4cf1-8f5c-4ea7af02fd98</serial>
Nov 09 00:44:34 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:44:34 user nova-compute[74441]: </disk>
Nov 09 00:44:34 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:44:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:44:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:37 user nova-compute[74441]: WARNING nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] While synchronizing instance power states, found 7 instances in the database and 5 instances on the hypervisor.
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid ffd43df5-7473-4cbf-aac1-52711f08e730 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 772ff868-f9c9-4cbf-a100-c57b3f5de48b {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid bf7c7bb1-037c-48a9-9673-b358578fa4eb {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:37 user nova-compute[74441]: INFO nova.compute.manager [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Terminating instance
Nov 09 00:44:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-0eac30b3-9e9e-45f4-87cc-01e7890bda89 req-ebd0f9de-d5c3-4308-903b-e5f748e9ad15 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-unplugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0eac30b3-9e9e-45f4-87cc-01e7890bda89 req-ebd0f9de-d5c3-4308-903b-e5f748e9ad15 service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0eac30b3-9e9e-45f4-87cc-01e7890bda89 req-ebd0f9de-d5c3-4308-903b-e5f748e9ad15 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0eac30b3-9e9e-45f4-87cc-01e7890bda89 req-ebd0f9de-d5c3-4308-903b-e5f748e9ad15 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-0eac30b3-9e9e-45f4-87cc-01e7890bda89 req-ebd0f9de-d5c3-4308-903b-e5f748e9ad15 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-unplugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-0eac30b3-9e9e-45f4-87cc-01e7890bda89 req-ebd0f9de-d5c3-4308-903b-e5f748e9ad15 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-unplugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Instance destroyed successfully.
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'resources' on Instance uuid d717ddbc-6c16-4b0b-812a-6cb46b5314dc {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-88303642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-88303642',id=2,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU2K0OW+0sJ+wwOPgYhH0cv/tCXPXCJeBIP8GE3Z/9n5f7E63IgDULTOQpNDGvh0Hj9/dhOwj0uaLKCYDS/6dUQgUBVusLFERHApraybJANbOANs/xDMdQKEcLYp0yCew==',key_name='tempest-keypair-555090617',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:42:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-xa6rl5bw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=d717ddbc-6c16-4b0b-812a-6cb46b5314dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "958e30c3-1bcc-4902-8868-851d7f71c00e", "address": "fa:16:3e:fd:53:97", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958e30c3-1b", "ovs_interfaceid": "958e30c3-1bcc-4902-8868-851d7f71c00e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG os_vif [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap958e30c3-1b, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f71c11b0-37b6-4825-bec5-0a510cda92a3) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:38 user nova-compute[74441]: INFO os_vif [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:97,bridge_name='br-int',has_traffic_filtering=True,id=958e30c3-1bcc-4902-8868-851d7f71c00e,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958e30c3-1b')
Nov 09 00:44:38 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Deleting instance files /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc_del
Nov 09 00:44:38 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Deletion of /opt/stack/data/nova/instances/d717ddbc-6c16-4b0b-812a-6cb46b5314dc_del complete
Nov 09 00:44:38 user nova-compute[74441]: INFO nova.compute.manager [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 09 00:44:38 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:44:38 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:44:39 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:39 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Took 1.25 seconds to deallocate network for instance.
Nov 09 00:44:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] Acquiring lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] No waiting events found dispatching network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:40 user nova-compute[74441]: WARNING nova.compute.manager [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received unexpected event network-vif-plugged-958e30c3-1bcc-4902-8868-851d7f71c00e for instance with vm_state deleted and task_state None.
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-6def1cf2-544f-4cec-b2f5-0867590f1c0b req-4a211bc3-7d4c-480e-a685-faf306966f07 service nova] [instance: d717ddbc-6c16-4b0b-812a-6cb46b5314dc] Received event network-vif-deleted-958e30c3-1bcc-4902-8868-851d7f71c00e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:44:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.815s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:40 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Deleted allocations for instance d717ddbc-6c16-4b0b-812a-6cb46b5314dc
Nov 09 00:44:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-54f53fc4-0283-441c-8b26-d84c613286bf tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "d717ddbc-6c16-4b0b-812a-6cb46b5314dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.173s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "378ca4d6-d23b-48f1-af42-c31978672971" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:44:48 user nova-compute[74441]: INFO nova.compute.claims [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Claim successful on node user
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:44:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:44:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.policy [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8e5ce70bd2b4a01934c18f8e12d89f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcc87a3fe1470cbae7846b8020ff0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:44:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Creating image(s)
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "/opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "/opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "/opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk 1073741824" returned: 0 in 0.058s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:44:49 user nova-compute[74441]: INFO nova.compute.claims [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Claim successful on node user
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.network.neutron [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Successfully created port: 2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Cannot resize image /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Ensure instance console log exists: /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.network.neutron [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:44:49 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.policy [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dee4ca1b1a8d432d943ba7bf20f41f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c24e7fc6e24dd0bc5c8ca3bfd1166f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:44:49 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Creating image(s)
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "/opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "/opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "/opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid ffd43df5-7473-4cbf-aac1-52711f08e730 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Successfully updated port: 2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk 1073741824" returned: 0 in 0.060s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-changed-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Refreshing instance network info cache due to event network-changed-2e977767-fc3b-4b97-8b3a-d58ea58a429a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] Acquiring lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] Acquired lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Refreshing network info cache for port 2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Successfully created port: 184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.229s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-55162f89-4511-46ca-a14f-4c980cf8006b req-20723f76-77ba-43c9-a4ac-30b4399576c2 service nova] Releasing lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquired lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Cannot resize image /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Ensure instance console log exists: /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating instance_info_cache with network_info: [{"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-ffd43df5-7473-4cbf-aac1-52711f08e730" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Updating instance_info_cache with network_info: [{"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Releasing lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Instance network_info: |[{"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Start _get_guest_xml network_info=[{"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:44:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1357908257',display_name='tempest-ServersNegativeTestJSON-server-1357908257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1357908257',id=15,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1fcc87a3fe1470cbae7846b8020ff0e',ramdisk_id='',reservation_id='r-9ms49jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-296355111',owner_user_name='tempest-ServersNegativeTestJSON-296355111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:49Z,user_data=None,user_id='d8e5ce70bd2b4a01934c18f8e12d89f0',uuid=378ca4d6-d23b-48f1-af42-c31978672971,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converting VIF {"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.objects.instance [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lazy-loading 'pci_devices' on Instance uuid 378ca4d6-d23b-48f1-af42-c31978672971 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:44:51 user nova-compute[74441]:   <uuid>378ca4d6-d23b-48f1-af42-c31978672971</uuid>
Nov 09 00:44:51 user nova-compute[74441]:   <name>instance-0000000f</name>
Nov 09 00:44:51 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:44:51 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:44:51 user nova-compute[74441]:   <metadata>
Nov 09 00:44:51 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:44:51 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:44:51 user nova-compute[74441]:       <nova:name>tempest-ServersNegativeTestJSON-server-1357908257</nova:name>
Nov 09 00:44:51 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:44:51</nova:creationTime>
Nov 09 00:44:51 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:44:51 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:44:51 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:44:51 user nova-compute[74441]:       <nova:owner>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:user uuid="d8e5ce70bd2b4a01934c18f8e12d89f0">tempest-ServersNegativeTestJSON-296355111-project-member</nova:user>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:project uuid="d1fcc87a3fe1470cbae7846b8020ff0e">tempest-ServersNegativeTestJSON-296355111</nova:project>
Nov 09 00:44:51 user nova-compute[74441]:       </nova:owner>
Nov 09 00:44:51 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:44:51 user nova-compute[74441]:       <nova:ports>
Nov 09 00:44:51 user nova-compute[74441]:         <nova:port uuid="2e977767-fc3b-4b97-8b3a-d58ea58a429a">
Nov 09 00:44:51 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 00:44:51 user nova-compute[74441]:         </nova:port>
Nov 09 00:44:51 user nova-compute[74441]:       </nova:ports>
Nov 09 00:44:51 user nova-compute[74441]:     </nova:instance>
Nov 09 00:44:51 user nova-compute[74441]:   </metadata>
Nov 09 00:44:51 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:44:51 user nova-compute[74441]:     <system>
Nov 09 00:44:51 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:44:51 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:44:51 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:44:51 user nova-compute[74441]:       <entry name="serial">378ca4d6-d23b-48f1-af42-c31978672971</entry>
Nov 09 00:44:51 user nova-compute[74441]:       <entry name="uuid">378ca4d6-d23b-48f1-af42-c31978672971</entry>
Nov 09 00:44:51 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:44:51 user nova-compute[74441]:     </system>
Nov 09 00:44:51 user nova-compute[74441]:   </sysinfo>
Nov 09 00:44:51 user nova-compute[74441]:   <os>
Nov 09 00:44:51 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:44:51 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:44:51 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:44:51 user nova-compute[74441]:   </os>
Nov 09 00:44:51 user nova-compute[74441]:   <features>
Nov 09 00:44:51 user nova-compute[74441]:     <acpi/>
Nov 09 00:44:51 user nova-compute[74441]:     <apic/>
Nov 09 00:44:51 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:44:51 user nova-compute[74441]:   </features>
Nov 09 00:44:51 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:44:51 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:44:51 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:44:51 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:44:51 user nova-compute[74441]:   </clock>
Nov 09 00:44:51 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:44:51 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:44:51 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:44:51 user nova-compute[74441]:   </cpu>
Nov 09 00:44:51 user nova-compute[74441]:   <devices>
Nov 09 00:44:51 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:44:51 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:44:51 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk"/>
Nov 09 00:44:51 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:44:51 user nova-compute[74441]:     </disk>
Nov 09 00:44:51 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:44:51 user nova-compute[74441]:       <mac address="fa:16:3e:0b:ab:6e"/>
Nov 09 00:44:51 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:51 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:44:51 user nova-compute[74441]:       <target dev="tap2e977767-fc"/>
Nov 09 00:44:51 user nova-compute[74441]:     </interface>
Nov 09 00:44:51 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:44:51 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/console.log" append="off"/>
Nov 09 00:44:51 user nova-compute[74441]:     </serial>
Nov 09 00:44:51 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:44:51 user nova-compute[74441]:     <video>
Nov 09 00:44:51 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:51 user nova-compute[74441]:     </video>
Nov 09 00:44:51 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:44:51 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:44:51 user nova-compute[74441]:     </rng>
Nov 09 00:44:51 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:44:51 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:44:51 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:44:51 user nova-compute[74441]:     </memballoon>
Nov 09 00:44:51 user nova-compute[74441]:   </devices>
Nov 09 00:44:51 user nova-compute[74441]: </domain>
Nov 09 00:44:51 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1357908257',display_name='tempest-ServersNegativeTestJSON-server-1357908257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1357908257',id=15,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1fcc87a3fe1470cbae7846b8020ff0e',ramdisk_id='',reservation_id='r-9ms49jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-296355111',owner_user_name='tempest-ServersNegativeTestJSON-296355111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:49Z,user_data=None,user_id='d8e5ce70bd2b4a01934c18f8e12d89f0',uuid=378ca4d6-d23b-48f1-af42-c31978672971,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converting VIF {"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG os_vif [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98e92e5e-0afc-507c-bcf5-213cd85ab4fb', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Successfully updated port: 184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e977767-fc, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e977767-fc, col_values=(('qos', UUID('e52db126-2f85-483e-b58f-6d2a1378d8e4')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e977767-fc, col_values=(('external_ids', {'iface-id': '2e977767-fc3b-4b97-8b3a-d58ea58a429a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ab:6e', 'vm-uuid': '378ca4d6-d23b-48f1-af42-c31978672971'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-changed-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Refreshing instance network info cache due to event network-changed-184a62e0-be26-4fff-a8f4-927393e2f732. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:51 user nova-compute[74441]: INFO os_vif [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc')
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] No VIF found with MAC fa:16:3e:0b:ab:6e, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Instance network_info: |[{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.neutron [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Refreshing network info cache for port 184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Start _get_guest_xml network_info=[{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:44:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1454423779',display_name='tempest-ServerActionsTestOtherA-server-1454423779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1454423779',id=16,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-dvcmhhgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=499d7158-9ed0-44e3-ba68-96ba7574f469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG nova.objects.instance [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'pci_devices' on Instance uuid 499d7158-9ed0-44e3-ba68-96ba7574f469 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:44:52 user nova-compute[74441]:   <uuid>499d7158-9ed0-44e3-ba68-96ba7574f469</uuid>
Nov 09 00:44:52 user nova-compute[74441]:   <name>instance-00000010</name>
Nov 09 00:44:52 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:44:52 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:44:52 user nova-compute[74441]:   <metadata>
Nov 09 00:44:52 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:44:52 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:44:52 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherA-server-1454423779</nova:name>
Nov 09 00:44:52 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:44:51</nova:creationTime>
Nov 09 00:44:52 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:44:52 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:44:52 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:44:52 user nova-compute[74441]:       <nova:owner>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:user uuid="dee4ca1b1a8d432d943ba7bf20f41f1b">tempest-ServerActionsTestOtherA-1357980906-project-member</nova:user>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:project uuid="24c24e7fc6e24dd0bc5c8ca3bfd1166f">tempest-ServerActionsTestOtherA-1357980906</nova:project>
Nov 09 00:44:52 user nova-compute[74441]:       </nova:owner>
Nov 09 00:44:52 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:44:52 user nova-compute[74441]:       <nova:ports>
Nov 09 00:44:52 user nova-compute[74441]:         <nova:port uuid="184a62e0-be26-4fff-a8f4-927393e2f732">
Nov 09 00:44:52 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 00:44:52 user nova-compute[74441]:         </nova:port>
Nov 09 00:44:52 user nova-compute[74441]:       </nova:ports>
Nov 09 00:44:52 user nova-compute[74441]:     </nova:instance>
Nov 09 00:44:52 user nova-compute[74441]:   </metadata>
Nov 09 00:44:52 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:44:52 user nova-compute[74441]:     <system>
Nov 09 00:44:52 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:44:52 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:44:52 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:44:52 user nova-compute[74441]:       <entry name="serial">499d7158-9ed0-44e3-ba68-96ba7574f469</entry>
Nov 09 00:44:52 user nova-compute[74441]:       <entry name="uuid">499d7158-9ed0-44e3-ba68-96ba7574f469</entry>
Nov 09 00:44:52 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:44:52 user nova-compute[74441]:     </system>
Nov 09 00:44:52 user nova-compute[74441]:   </sysinfo>
Nov 09 00:44:52 user nova-compute[74441]:   <os>
Nov 09 00:44:52 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:44:52 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:44:52 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:44:52 user nova-compute[74441]:   </os>
Nov 09 00:44:52 user nova-compute[74441]:   <features>
Nov 09 00:44:52 user nova-compute[74441]:     <acpi/>
Nov 09 00:44:52 user nova-compute[74441]:     <apic/>
Nov 09 00:44:52 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:44:52 user nova-compute[74441]:   </features>
Nov 09 00:44:52 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:44:52 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:44:52 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:44:52 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:44:52 user nova-compute[74441]:   </clock>
Nov 09 00:44:52 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:44:52 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:44:52 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:44:52 user nova-compute[74441]:   </cpu>
Nov 09 00:44:52 user nova-compute[74441]:   <devices>
Nov 09 00:44:52 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:44:52 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:44:52 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk"/>
Nov 09 00:44:52 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:44:52 user nova-compute[74441]:     </disk>
Nov 09 00:44:52 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:44:52 user nova-compute[74441]:       <mac address="fa:16:3e:79:11:53"/>
Nov 09 00:44:52 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:52 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:44:52 user nova-compute[74441]:       <target dev="tap184a62e0-be"/>
Nov 09 00:44:52 user nova-compute[74441]:     </interface>
Nov 09 00:44:52 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:44:52 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/console.log" append="off"/>
Nov 09 00:44:52 user nova-compute[74441]:     </serial>
Nov 09 00:44:52 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:44:52 user nova-compute[74441]:     <video>
Nov 09 00:44:52 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:52 user nova-compute[74441]:     </video>
Nov 09 00:44:52 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:44:52 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:44:52 user nova-compute[74441]:     </rng>
Nov 09 00:44:52 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:44:52 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:44:52 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:44:52 user nova-compute[74441]:     </memballoon>
Nov 09 00:44:52 user nova-compute[74441]:   </devices>
Nov 09 00:44:52 user nova-compute[74441]: </domain>
Nov 09 00:44:52 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1454423779',display_name='tempest-ServerActionsTestOtherA-server-1454423779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1454423779',id=16,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-dvcmhhgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=499d7158-9ed0-44e3-ba68-96ba7574f469,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG os_vif [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04c78b88-44f5-54ef-9525-c9005e5c1ff6', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap184a62e0-be, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap184a62e0-be, col_values=(('qos', UUID('8d74d6a8-d1e0-4c62-bb69-dccf7da4d6fd')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap184a62e0-be, col_values=(('external_ids', {'iface-id': '184a62e0-be26-4fff-a8f4-927393e2f732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:11:53', 'vm-uuid': '499d7158-9ed0-44e3-ba68-96ba7574f469'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: INFO os_vif [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be')
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No VIF found with MAC fa:16:3e:79:11:53, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.network.neutron [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updated VIF entry in instance network info cache for port 184a62e0-be26-4fff-a8f4-927393e2f732. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.network.neutron [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:44:52 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:52 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=25.414058685302734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5241429a-f5c5-4cdb-ad20-870520713b4e req-d224305f-7542-4886-943e-d98392c1de11 service nova] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ffd43df5-7473-4cbf-aac1-52711f08e730 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 772ff868-f9c9-4cbf-a100-c57b3f5de48b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:44:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:44:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Creating image(s)
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Ensure instance console log exists: /opt/stack/data/nova/instances/bf7c7bb1-037c-48a9-9673-b358578fa4eb/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Start _get_guest_xml network_info=[{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROlkEIbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf7c7bb1-037c-48a9-9673-b358578fa4eb', 'attached_at': '', 'detached_at': '', 'volume_id': '9d1bdad4-636f-45d3-bde5-7276ef7ada6c', 'serial': '9d1bdad4-636f-45d3-bde5-7276ef7ada6c'}, 'attachment_id': '359604d1-ac1d-4dc2-9dfb-bddd70f8c702', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:44:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROlkEIbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:44:53 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:44:53 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:44:53 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44be365-2577-49e0-9b26-57441a149f40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:44:53 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e16825c-07ef-4360-bd6b-2e6767ef1687]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c] added
Nov 09 00:44:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d0a826-55c8-4909-810c-b5a005e4bfb7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[330016f5-bf70-4f0b-8d1f-2dc6154eaf4f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROlkEIbM {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ROlkEIbM" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcda17b-91e5-4043-a5ec-30ec69747f77]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ROlkEIbM'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7328ed-cc94-41b6-a362-a294d5a92858]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be08a68-5be4-4903-8f22-e47123d7d8d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:53 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:53 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:44:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[625521da-cb9e-4556-9d53-4f59f13a5abc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260]
Nov 09 00:44:54 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260] successful.
Nov 09 00:44:54 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f6c8e-9637-4fd6-be1c-66e2bd40aa7b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463673f-5c36-4521-9b1c-13a9b9a42885]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:54 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:54 user nova-compute[74441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:44:54 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:54 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:54 user nova-compute[74441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:44:54 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6dfe9e-d575-4f7a-b81f-8e0bfec352b2]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROlkEIbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-12722b13-cfc8-4a9a-bfc5-46c12f11d4a8 req-09448d0b-2d27-46cb-9638-a7ea77859a29 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-12722b13-cfc8-4a9a-bfc5-46c12f11d4a8 req-09448d0b-2d27-46cb-9638-a7ea77859a29 service nova] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-12722b13-cfc8-4a9a-bfc5-46c12f11d4a8 req-09448d0b-2d27-46cb-9638-a7ea77859a29 service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-12722b13-cfc8-4a9a-bfc5-46c12f11d4a8 req-09448d0b-2d27-46cb-9638-a7ea77859a29 service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-12722b13-cfc8-4a9a-bfc5-46c12f11d4a8 req-09448d0b-2d27-46cb-9638-a7ea77859a29 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] No waiting events found dispatching network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:54 user nova-compute[74441]: WARNING nova.compute.manager [req-12722b13-cfc8-4a9a-bfc5-46c12f11d4a8 req-09448d0b-2d27-46cb-9638-a7ea77859a29 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received unexpected event network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a for instance with vm_state building and task_state spawning.
Nov 09 00:44:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:54 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 is timed out.
Nov 09 00:44:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Successfully detached device vdb from instance 9c7f9274-3740-4dbc-83cb-20101ae1e734 from the live domain config.
Nov 09 00:44:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMpKmwzJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:44:54 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:44:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-33b82efd-9770-4f9c-8c02-7306360d0349 req-13519b77-aa05-4040-8c34-0148f3847820 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-33b82efd-9770-4f9c-8c02-7306360d0349 req-13519b77-aa05-4040-8c34-0148f3847820 service nova] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-33b82efd-9770-4f9c-8c02-7306360d0349 req-13519b77-aa05-4040-8c34-0148f3847820 service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-33b82efd-9770-4f9c-8c02-7306360d0349 req-13519b77-aa05-4040-8c34-0148f3847820 service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-33b82efd-9770-4f9c-8c02-7306360d0349 req-13519b77-aa05-4040-8c34-0148f3847820 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] No waiting events found dispatching network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:54 user nova-compute[74441]: WARNING nova.compute.manager [req-33b82efd-9770-4f9c-8c02-7306360d0349 req-13519b77-aa05-4040-8c34-0148f3847820 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received unexpected event network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 for instance with vm_state building and task_state spawning.
Nov 09 00:44:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23166373631343461', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166373631343461', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.599s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5062f-32a9-4299-9175-4ee38f7cf398]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:44:55 user nova-compute[74441]: No targets found.
Nov 09 00:44:55 user nova-compute[74441]: iSNS:
Nov 09 00:44:55 user nova-compute[74441]: No targets found.
Nov 09 00:44:55 user nova-compute[74441]: STATIC:
Nov 09 00:44:55 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c
Nov 09 00:44:55 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:55 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:55 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98
Nov 09 00:44:55 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:55 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:55 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287
Nov 09 00:44:55 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:44:55 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:44:55 user nova-compute[74441]: FIRMWARE:
Nov 09 00:44:55 user nova-compute[74441]: No targets found.
Nov 09 00:44:55 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:44:55 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:44:55 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-309605040',display_name='tempest-TestShelveInstance-server-309605040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-309605040',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+r1EebhzWODdwxNpuHCbaaB/Iynhmbpl7LKEvpyAdHm7lJ97eJVDP4i3gqE4osK2rK81EWsg+TGGZIMyRTQemF3OkdiV8K34qdKmwuqLlPNOe/fLLbo7NOpwwU7LFeaQ==',key_name='tempest-TestShelveInstance-360366387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='759f5f84856747d988ba0d33fe456f4e',ramdisk_id='',reservation_id='r-tu697iy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1685523103',owner_user_name='tempest-TestShelveInstance-1685523103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:26Z,user_data=None,user_id='714111389c1c4641b4461a684981ad0c',uuid=bf7c7bb1-037c-48a9-9673-b358578fa4eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Converting VIF {"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lazy-loading 'pci_devices' on Instance uuid bf7c7bb1-037c-48a9-9673-b358578fa4eb {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:44:55 user nova-compute[74441]:   <uuid>bf7c7bb1-037c-48a9-9673-b358578fa4eb</uuid>
Nov 09 00:44:55 user nova-compute[74441]:   <name>instance-0000000e</name>
Nov 09 00:44:55 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:44:55 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:44:55 user nova-compute[74441]:   <metadata>
Nov 09 00:44:55 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:44:55 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:44:55 user nova-compute[74441]:       <nova:name>tempest-TestShelveInstance-server-309605040</nova:name>
Nov 09 00:44:55 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:44:53</nova:creationTime>
Nov 09 00:44:55 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:44:55 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:44:55 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:44:55 user nova-compute[74441]:       <nova:owner>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:user uuid="714111389c1c4641b4461a684981ad0c">tempest-TestShelveInstance-1685523103-project-member</nova:user>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:project uuid="759f5f84856747d988ba0d33fe456f4e">tempest-TestShelveInstance-1685523103</nova:project>
Nov 09 00:44:55 user nova-compute[74441]:       </nova:owner>
Nov 09 00:44:55 user nova-compute[74441]:       <nova:ports>
Nov 09 00:44:55 user nova-compute[74441]:         <nova:port uuid="84b58c57-9620-47d6-80c3-af900e6db54a">
Nov 09 00:44:55 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:44:55 user nova-compute[74441]:         </nova:port>
Nov 09 00:44:55 user nova-compute[74441]:       </nova:ports>
Nov 09 00:44:55 user nova-compute[74441]:     </nova:instance>
Nov 09 00:44:55 user nova-compute[74441]:   </metadata>
Nov 09 00:44:55 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:44:55 user nova-compute[74441]:     <system>
Nov 09 00:44:55 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:44:55 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:44:55 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:44:55 user nova-compute[74441]:       <entry name="serial">bf7c7bb1-037c-48a9-9673-b358578fa4eb</entry>
Nov 09 00:44:55 user nova-compute[74441]:       <entry name="uuid">bf7c7bb1-037c-48a9-9673-b358578fa4eb</entry>
Nov 09 00:44:55 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:44:55 user nova-compute[74441]:     </system>
Nov 09 00:44:55 user nova-compute[74441]:   </sysinfo>
Nov 09 00:44:55 user nova-compute[74441]:   <os>
Nov 09 00:44:55 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:44:55 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:44:55 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:44:55 user nova-compute[74441]:   </os>
Nov 09 00:44:55 user nova-compute[74441]:   <features>
Nov 09 00:44:55 user nova-compute[74441]:     <acpi/>
Nov 09 00:44:55 user nova-compute[74441]:     <apic/>
Nov 09 00:44:55 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:44:55 user nova-compute[74441]:   </features>
Nov 09 00:44:55 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:44:55 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:44:55 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:44:55 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:44:55 user nova-compute[74441]:   </clock>
Nov 09 00:44:55 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:44:55 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:44:55 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:44:55 user nova-compute[74441]:   </cpu>
Nov 09 00:44:55 user nova-compute[74441]:   <devices>
Nov 09 00:44:55 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:44:55 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:44:55 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 00:44:55 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:44:55 user nova-compute[74441]:       <serial>9d1bdad4-636f-45d3-bde5-7276ef7ada6c</serial>
Nov 09 00:44:55 user nova-compute[74441]:     </disk>
Nov 09 00:44:55 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:44:55 user nova-compute[74441]:       <mac address="fa:16:3e:7f:a2:ed"/>
Nov 09 00:44:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:55 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:44:55 user nova-compute[74441]:       <target dev="tap84b58c57-96"/>
Nov 09 00:44:55 user nova-compute[74441]:     </interface>
Nov 09 00:44:55 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:44:55 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/bf7c7bb1-037c-48a9-9673-b358578fa4eb/console.log" append="off"/>
Nov 09 00:44:55 user nova-compute[74441]:     </serial>
Nov 09 00:44:55 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:44:55 user nova-compute[74441]:     <video>
Nov 09 00:44:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:44:55 user nova-compute[74441]:     </video>
Nov 09 00:44:55 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:44:55 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:44:55 user nova-compute[74441]:     </rng>
Nov 09 00:44:55 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:44:55 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:44:55 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:44:55 user nova-compute[74441]:     </memballoon>
Nov 09 00:44:55 user nova-compute[74441]:   </devices>
Nov 09 00:44:55 user nova-compute[74441]: </domain>
Nov 09 00:44:55 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-309605040',display_name='tempest-TestShelveInstance-server-309605040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-309605040',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+r1EebhzWODdwxNpuHCbaaB/Iynhmbpl7LKEvpyAdHm7lJ97eJVDP4i3gqE4osK2rK81EWsg+TGGZIMyRTQemF3OkdiV8K34qdKmwuqLlPNOe/fLLbo7NOpwwU7LFeaQ==',key_name='tempest-TestShelveInstance-360366387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='759f5f84856747d988ba0d33fe456f4e',ramdisk_id='',reservation_id='r-tu697iy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1685523103',owner_user_name='tempest-TestShelveInstance-1685523103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:44:26Z,user_data=None,user_id='714111389c1c4641b4461a684981ad0c',uuid=bf7c7bb1-037c-48a9-9673-b358578fa4eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Converting VIF {"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_vif [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb1d708-64eb-413b-8166-ca731ff03e99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c639576f-fb15-5ede-8ecc-13fa55645cd4', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84b58c57-96, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84b58c57-96, col_values=(('qos', UUID('899aa5a8-6fe6-4aec-a3c8-0c4c3cfd13fa')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84b58c57-96, col_values=(('external_ids', {'iface-id': '84b58c57-9620-47d6-80c3-af900e6db54a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:a2:ed', 'vm-uuid': 'bf7c7bb1-037c-48a9-9673-b358578fa4eb'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb66486e-a37e-46c5-b1af-222f1f31721c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:55 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:55 user nova-compute[74441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:44:55 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 (non-flash)
Nov 09 00:44:55 user nova-compute[74441]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:44:55 user nova-compute[74441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:44:55 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c643eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: INFO os_vif [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96')
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[402624b1-ab94-49e3-bdbb-4506813c2286]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[305d2759-4403-489f-9987-34135332d180]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] No VIF found with MAC fa:16:3e:7f:a2:ed, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b0f203-2b93-49ac-b11d-794570defa2e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e6ea37-8453-495e-9f78-afa4531cf2ac]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ceef87-6ff1-4134-8a45-d70e41cac89d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12986aff-04f3-4d3c-813e-084ab1768e0f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260]
Nov 09 00:44:55 user nova-compute[74441]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98, portal: 172.16.0.220,3260] successful.
Nov 09 00:44:55 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce983810-1854-4cf1-8f5c-4ea7af02fd98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd34dbbc-419d-4937-9297-2a5f41430a25]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] <== disconnect_volume: return (1001ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:44:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-54cb92e3-44e3-4ad0-9baa-0283ca51ed77 req-231f267e-a70d-47bc-818c-8a32c3a90d77 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-54cb92e3-44e3-4ad0-9baa-0283ca51ed77 req-231f267e-a70d-47bc-818c-8a32c3a90d77 service nova] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-54cb92e3-44e3-4ad0-9baa-0283ca51ed77 req-231f267e-a70d-47bc-818c-8a32c3a90d77 service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-54cb92e3-44e3-4ad0-9baa-0283ca51ed77 req-231f267e-a70d-47bc-818c-8a32c3a90d77 service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-54cb92e3-44e3-4ad0-9baa-0283ca51ed77 req-231f267e-a70d-47bc-818c-8a32c3a90d77 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] No waiting events found dispatching network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:56 user nova-compute[74441]: WARNING nova.compute.manager [req-54cb92e3-44e3-4ad0-9baa-0283ca51ed77 req-231f267e-a70d-47bc-818c-8a32c3a90d77 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received unexpected event network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a for instance with vm_state building and task_state spawning.
Nov 09 00:44:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-3d5d322f-b0d2-4815-9d77-b12d0033130a req-14e5e761-9868-4036-a56b-85772d56398b service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d5d322f-b0d2-4815-9d77-b12d0033130a req-14e5e761-9868-4036-a56b-85772d56398b service nova] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d5d322f-b0d2-4815-9d77-b12d0033130a req-14e5e761-9868-4036-a56b-85772d56398b service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d5d322f-b0d2-4815-9d77-b12d0033130a req-14e5e761-9868-4036-a56b-85772d56398b service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-3d5d322f-b0d2-4815-9d77-b12d0033130a req-14e5e761-9868-4036-a56b-85772d56398b service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] No waiting events found dispatching network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:56 user nova-compute[74441]: WARNING nova.compute.manager [req-3d5d322f-b0d2-4815-9d77-b12d0033130a req-14e5e761-9868-4036-a56b-85772d56398b service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received unexpected event network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 for instance with vm_state building and task_state spawning.
Nov 09 00:44:56 user nova-compute[74441]: DEBUG nova.objects.instance [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'flavor' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-db13aa2c-c30d-42f0-9d11-1687ee70d56e tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.873s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.614s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:44:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Instance spawned successfully.
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:44:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Instance spawned successfully.
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:57 user nova-compute[74441]: INFO nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Took 8.92 seconds to spawn the instance on the hypervisor.
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:44:57 user nova-compute[74441]: INFO nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Took 7.67 seconds to spawn the instance on the hypervisor.
Nov 09 00:44:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:44:57 user nova-compute[74441]: INFO nova.compute.manager [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Took 9.68 seconds to build instance.
Nov 09 00:44:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-095646fe-f36f-4e23-bcad-302035a70842 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "378ca4d6-d23b-48f1-af42-c31978672971" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.791s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:57 user nova-compute[74441]: INFO nova.compute.manager [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Took 8.65 seconds to build instance.
Nov 09 00:44:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:44:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-89f7851f-9153-4607-8cce-c73d8745c260 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.795s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] No waiting events found dispatching network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:58 user nova-compute[74441]: WARNING nova.compute.manager [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received unexpected event network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a for instance with vm_state building and task_state spawning.
Nov 09 00:44:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] No waiting events found dispatching network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:44:58 user nova-compute[74441]: WARNING nova.compute.manager [req-8c919592-2ddf-4722-8e42-7518db309fb8 req-d39420cf-29d6-456a-b248-1900d7d152bb service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received unexpected event network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a for instance with vm_state building and task_state spawning.
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:44:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance spawned successfully.
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:44:59 user nova-compute[74441]: INFO nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 09 00:44:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:44:59 user nova-compute[74441]: INFO nova.compute.manager [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Took 34.64 seconds to build instance.
Nov 09 00:44:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-08643115-9a63-4798-8de6-27d333d16504 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.763s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:44:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 22.460s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:44:59 user nova-compute[74441]: INFO nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 09 00:44:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:04 user nova-compute[74441]: INFO nova.compute.manager [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Terminating instance
Nov 09 00:45:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-a16c1de0-e982-4831-a396-0703d0ee226e req-5468e446-7240-407b-b423-eb8c7b85ebd9 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a16c1de0-e982-4831-a396-0703d0ee226e req-5468e446-7240-407b-b423-eb8c7b85ebd9 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a16c1de0-e982-4831-a396-0703d0ee226e req-5468e446-7240-407b-b423-eb8c7b85ebd9 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a16c1de0-e982-4831-a396-0703d0ee226e req-5468e446-7240-407b-b423-eb8c7b85ebd9 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-a16c1de0-e982-4831-a396-0703d0ee226e req-5468e446-7240-407b-b423-eb8c7b85ebd9 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-a16c1de0-e982-4831-a396-0703d0ee226e req-5468e446-7240-407b-b423-eb8c7b85ebd9 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Instance destroyed successfully.
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lazy-loading 'resources' on Instance uuid ffd43df5-7473-4cbf-aac1-52711f08e730 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1328300774',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-131231847',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhNlCCZx6xii87AgroIHY4kUCQ+iFfYCnreRdGg2szTS8Xh+BOox5k6rsoS0vhTFKUMZFNqmluqNwT9TNCdC/4eRnP5Yt+l1XOe9CLT13M16/eqOS1scP3PQJ8uNIYBtw==',key_name='tempest-keypair-957284537',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:43:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b473302f384e4279a9d098c44eb31e96',ramdisk_id='',reservation_id='r-cswotsek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-302690474',owner_user_name='tempest-ServerActionsV293TestJSON-302690474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:43:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1bc19273fa047e7bec957c05a6f0e4a',uuid=ffd43df5-7473-4cbf-aac1-52711f08e730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converting VIF {"id": "00d12234-ef41-4e58-a03a-4180752d7d2f", "address": "fa:16:3e:9e:05:04", "network": {"id": "a948a801-e09b-4ca5-9e32-62572906b955", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1702067537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b473302f384e4279a9d098c44eb31e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d12234-ef", "ovs_interfaceid": "00d12234-ef41-4e58-a03a-4180752d7d2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_vif [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00d12234-ef, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0e4c7b9-54a4-42f1-b9f4-6a03d401e283) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:05 user nova-compute[74441]: INFO os_vif [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:05:04,bridge_name='br-int',has_traffic_filtering=True,id=00d12234-ef41-4e58-a03a-4180752d7d2f,network=Network(a948a801-e09b-4ca5-9e32-62572906b955),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d12234-ef')
Nov 09 00:45:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZGaDVcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:45:05 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5890929-5595-4c60-a221-2331170e0554]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:45:05 user nova-compute[74441]: No targets found.
Nov 09 00:45:05 user nova-compute[74441]: iSNS:
Nov 09 00:45:05 user nova-compute[74441]: No targets found.
Nov 09 00:45:05 user nova-compute[74441]: STATIC:
Nov 09 00:45:05 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c
Nov 09 00:45:05 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:45:05 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:45:05 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287
Nov 09 00:45:05 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:45:05 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:45:05 user nova-compute[74441]: FIRMWARE:
Nov 09 00:45:05 user nova-compute[74441]: No targets found.
Nov 09 00:45:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:45:05 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:45:05 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d25ac68-b703-4c15-81a6-9db615e6bf6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d94a22-10a4-4c20-892c-5313d98281e4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:45:05 user nova-compute[74441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 (non-flash)
Nov 09 00:45:05 user nova-compute[74441]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c641990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a64ed9-f8f3-4832-afcd-784c25740ddf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[001d7418-7ad7-4e88-8a19-93069aca22bf]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1794dcc-86fc-4099-bdf0-91cae2a70c7f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[effeb801-00fa-44b2-b995-7d357da45bf7]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba58958-9a77-485c-920d-1647375b59af]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2d20f-95a7-4005-a6e3-ae8f6d941173]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260]
Nov 09 00:45:06 user nova-compute[74441]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287, portal: 172.16.0.220,3260] successful.
Nov 09 00:45:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8540ef16-d3c0-427d-a8df-7e7eac6be287 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd78c55c-271e-42f0-a288-96b9a6df6340]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] <== disconnect_volume: return (388ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:45:06 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Deleting instance files /opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730_del
Nov 09 00:45:06 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Deletion of /opt/stack/data/nova/instances/ffd43df5-7473-4cbf-aac1-52711f08e730_del complete
Nov 09 00:45:06 user nova-compute[74441]: INFO nova.compute.manager [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 09 00:45:06 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:45:07 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Took 1.08 seconds to deallocate network for instance.
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:07 user nova-compute[74441]: WARNING nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state deleting.
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:07 user nova-compute[74441]: WARNING nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state deleting.
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:07 user nova-compute[74441]: WARNING nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state deleting.
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-unplugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Acquiring lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] No waiting events found dispatching network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:07 user nova-compute[74441]: WARNING nova.compute.manager [req-2d5db324-0c41-4cb0-802f-69fba7a85bf7 req-148251c2-e152-4a5f-aaa7-2a751b28ce72 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received unexpected event network-vif-plugged-00d12234-ef41-4e58-a03a-4180752d7d2f for instance with vm_state active and task_state deleting.
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-e9564faa-e7f1-4735-861f-ee7729677af2 req-b87920e0-b3ce-4e13-af0d-65490dfa7a05 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Received event network-vif-deleted-00d12234-ef41-4e58-a03a-4180752d7d2f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:07 user nova-compute[74441]: INFO nova.compute.manager [req-e9564faa-e7f1-4735-861f-ee7729677af2 req-b87920e0-b3ce-4e13-af0d-65490dfa7a05 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Neutron deleted interface 00d12234-ef41-4e58-a03a-4180752d7d2f; detaching it from the instance and deleting it from the info cache
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-e9564faa-e7f1-4735-861f-ee7729677af2 req-b87920e0-b3ce-4e13-af0d-65490dfa7a05 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-e9564faa-e7f1-4735-861f-ee7729677af2 req-b87920e0-b3ce-4e13-af0d-65490dfa7a05 service nova] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Detach interface failed, port_id=00d12234-ef41-4e58-a03a-4180752d7d2f, reason: Instance ffd43df5-7473-4cbf-aac1-52711f08e730 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 00:45:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:08 user nova-compute[74441]: INFO nova.compute.manager [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Took 1.02 seconds to detach 1 volumes for instance.
Nov 09 00:45:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] [instance: ffd43df5-7473-4cbf-aac1-52711f08e730] Deleting volume: 8540ef16-d3c0-427d-a8df-7e7eac6be287 {{(pid=74441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 00:45:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:08 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:45:08 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:45:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:08 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Deleted allocations for instance ffd43df5-7473-4cbf-aac1-52711f08e730
Nov 09 00:45:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3beba898-bf26-4815-84a6-841d4da99c18 tempest-ServerActionsV293TestJSON-302690474 tempest-ServerActionsV293TestJSON-302690474-project-member] Lock "ffd43df5-7473-4cbf-aac1-52711f08e730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.058s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'flavor' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:15 user nova-compute[74441]: INFO nova.compute.manager [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Attaching volume 84051cd9-ed96-413b-8135-fa3611cde4dc to /dev/vdb
Nov 09 00:45:15 user nova-compute[74441]: DEBUG os_brick.utils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b409a5b1-4594-4108-a4ee-5dc49fc14bde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f7ae9-c93c-49a6-9cf3-67394c9b22a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4be1fe5-c376-4b88-a048-47328fe6cb70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fef3e81-fd77-4246-82ed-fb9f4e741938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:45:15 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:45:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afcdf9f-b0e7-444e-8874-37c07fbea751]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:45:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:45:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:45:16 user nova-compute[74441]: DEBUG os_brick.utils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:45:16 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating existing volume attachment record: 2c5580c5-dc88-4e05-bb4e-6309bca6f99f {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:45:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:24 user nova-compute[74441]: INFO nova.compute.manager [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Terminating instance
Nov 09 00:45:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-420bd395-531d-4b67-82ed-d2664dbbc9f4 req-a28259d8-f190-431d-bad2-bba0e232a873 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-vif-unplugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-420bd395-531d-4b67-82ed-d2664dbbc9f4 req-a28259d8-f190-431d-bad2-bba0e232a873 service nova] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-420bd395-531d-4b67-82ed-d2664dbbc9f4 req-a28259d8-f190-431d-bad2-bba0e232a873 service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-420bd395-531d-4b67-82ed-d2664dbbc9f4 req-a28259d8-f190-431d-bad2-bba0e232a873 service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-420bd395-531d-4b67-82ed-d2664dbbc9f4 req-a28259d8-f190-431d-bad2-bba0e232a873 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] No waiting events found dispatching network-vif-unplugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-420bd395-531d-4b67-82ed-d2664dbbc9f4 req-a28259d8-f190-431d-bad2-bba0e232a873 service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-vif-unplugged-5adb70c4-ff83-4670-8854-d462854faebe for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:45:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Instance destroyed successfully.
Nov 09 00:45:25 user nova-compute[74441]: DEBUG nova.objects.instance [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lazy-loading 'resources' on Instance uuid 9c7f9274-3740-4dbc-83cb-20101ae1e734 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1875781353',display_name='tempest-TestServerVolumeAttachmentScenario-server-1875781353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1875781353',id=9,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh7g85WaZ1lM2jaAfxvMzbz/olX34dnABo85gSFvW7c0v4xq1Opo2ThmXvHzubqZWCNB6abNhF44BR3vZDPywSn94ybo/bYVvDkafX3ifuicgmF3k4iAHMzY4F9gI7h+Q==',key_name='tempest-keypair-606405707',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68981be0b4b94f7296294e7925cb295f',ramdisk_id='',reservation_id='r-lfi4lz81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1363956015',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1363956015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8f2aaf1a8074b61838ece6cc77a8201',uuid=9c7f9274-3740-4dbc-83cb-20101ae1e734,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Converting VIF {"id": "5adb70c4-ff83-4670-8854-d462854faebe", "address": "fa:16:3e:9a:b8:71", "network": {"id": "af1442f7-a4e8-4af0-b314-f5f6dc3901c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-727482235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68981be0b4b94f7296294e7925cb295f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5adb70c4-ff", "ovs_interfaceid": "5adb70c4-ff83-4670-8854-d462854faebe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG os_vif [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5adb70c4-ff, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=735d77c7-2d81-4c1d-a20d-c5958ff38eb9) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:25 user nova-compute[74441]: INFO os_vif [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:b8:71,bridge_name='br-int',has_traffic_filtering=True,id=5adb70c4-ff83-4670-8854-d462854faebe,network=Network(af1442f7-a4e8-4af0-b314-f5f6dc3901c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5adb70c4-ff')
Nov 09 00:45:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Deleting instance files /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734_del
Nov 09 00:45:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Deletion of /opt/stack/data/nova/instances/9c7f9274-3740-4dbc-83cb-20101ae1e734_del complete
Nov 09 00:45:25 user nova-compute[74441]: INFO nova.compute.manager [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 09 00:45:25 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:45:25 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:45:26 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Took 0.84 seconds to deallocate network for instance.
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] Acquiring lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] No waiting events found dispatching network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:26 user nova-compute[74441]: WARNING nova.compute.manager [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received unexpected event network-vif-plugged-5adb70c4-ff83-4670-8854-d462854faebe for instance with vm_state deleted and task_state None.
Nov 09 00:45:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3220227-73fd-4f3b-946f-5e93073e5c5e req-f0d43962-1802-46f0-a630-38b4ad219d6f service nova] [instance: 9c7f9274-3740-4dbc-83cb-20101ae1e734] Received event network-vif-deleted-5adb70c4-ff83-4670-8854-d462854faebe {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:26 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Deleted allocations for instance 9c7f9274-3740-4dbc-83cb-20101ae1e734
Nov 09 00:45:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-413bd90b-2c3e-46c0-b3ec-09cf8d619850 tempest-TestServerVolumeAttachmentScenario-1363956015 tempest-TestServerVolumeAttachmentScenario-1363956015-project-member] Lock "9c7f9274-3740-4dbc-83cb-20101ae1e734" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.601s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:45:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Creating image(s)
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Ensure instance console log exists: /opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Start _get_guest_xml network_info=[{"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMIGjAcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '772ff868-f9c9-4cbf-a100-c57b3f5de48b', 'attached_at': '', 'detached_at': '', 'volume_id': '7180e750-8d04-442f-9e73-d07278f76b8b', 'serial': '7180e750-8d04-442f-9e73-d07278f76b8b'}, 'attachment_id': '1910236c-b7c6-4966-ae90-48d59961a04c', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLpFUhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '772ff868-f9c9-4cbf-a100-c57b3f5de48b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff0fbada-4331-4d52-8e14-2eac745a702a', 'serial': 'ff0fbada-4331-4d52-8e14-2eac745a702a'}, 'attachment_id': '40ad960c-b54f-496f-9383-e5e2e7ab5b2a', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaZhlrnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '772ff868-f9c9-4cbf-a100-c57b3f5de48b', 'attached_at': '', 'detached_at': '', 'volume_id': '6d420062-7515-4f85-929e-46746d11cfcf', 'serial': '6d420062-7515-4f85-929e-46746d11cfcf'}, 'attachment_id': '0a690b9b-0599-482c-8ae5-e4a71147e359', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:45:29 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:45:29 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMIGjAcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:45:29 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:29 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:29 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[801dfe4d-fb6f-4b36-aa92-d5a2a365347d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:45:29 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba31f8-908d-4c6f-a506-59a8e5f562bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b] added
Nov 09 00:45:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc397490-214b-45d4-95c8-b3361004f428]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[592d34c3-8b58-46ba-99e0-25eb71c5ef3e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMIGjAcQ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMIGjAcQ" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c466299e-fd56-4bdf-be6b-91ff39be86cc]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JMIGjAcQ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fe5d34-bc20-405e-b91d-b2a8c81db5e7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cadb6d0-ac2d-4e50-87fd-9d16e41be990]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac274b43-27bc-4d8c-8c14-0c55281cb0b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260]
Nov 09 00:45:30 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260] successful.
Nov 09 00:45:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7734243-f8ef-44c1-9bab-57071caf2a10]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9a84b-9649-46f3-8f18-8bbedc13726d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:30 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:30 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc7fe79-0531-4440-b326-68ba4068cc0c]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:45:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMIGjAcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23933623139343036', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933623139343036', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLpFUhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:45:31 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:31 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:31 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d66da-dd6b-4c80-8136-7b5e7a5cf436]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:45:31 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b25c9-bf58-4f52-afe8-0e3970d64814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a] added
Nov 09 00:45:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a25ef49-d2cc-4a72-bf26-68b30f662655]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7f982-7b2d-4f46-9c67-3255b7a4b8b4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLpFUhot {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLpFUhot" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa37fb7-44c5-4b53-bc5e-861d693b16c7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLpFUhot'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3825cc06-50c7-4a5a-9618-2e1c9bcc4186]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d977551-1ee1-4ae0-ab55-b62891249615]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:31 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:31 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3407ace7-264c-479c-9b8f-58ce1558a1a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260]
Nov 09 00:45:31 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260] successful.
Nov 09 00:45:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c43c3e-5786-44a0-bfb7-42cc1a0c7d2e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6754573-f9e4-448c-9375-3e6a646bcdb1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:31 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:31 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:45:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:31 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:31 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:45:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ca361-27d6-43df-9d9f-4f46f1d476f7]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:45:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLpFUhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:45:32 user nova-compute[74441]: INFO nova.compute.claims [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Claim successful on node user
Nov 09 00:45:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23063663862656435', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063663862656435', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaZhlrnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:45:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:45:32 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf4df9-bec3-453b-a211-4748071a2167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:45:32 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63afeae8-b5c3-4220-bacb-19aa2e06e83a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf] added
Nov 09 00:45:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[487afd27-1f16-4ec4-9fcd-2aee859ad591]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74da2ff-f4e9-482e-97c6-e268d235be5e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaZhlrnI {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VaZhlrnI" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e413cd41-4994-4dd2-9283-1f4c4b6024df]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VaZhlrnI'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e7de8-12f1-4ca8-bd3f-c9b2b60d8873]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0c3b7-5a84-44c7-84c7-5de7595c2ec0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:45:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:45:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:45:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8844bb0d-24a3-4179-a227-c18eaf4b5ee7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260]
Nov 09 00:45:32 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260] successful.
Nov 09 00:45:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e0d70-437d-4939-9c69-0c4ac0dcb109]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bda360-3a1c-468b-a3ba-598ffce7756c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:45:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:45:32 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:45:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:45:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea2b452-3b3f-4e52-875a-c8909ec8dc59]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaZhlrnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.policy [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8b687249f4d41d680915f2d30fc8dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f51b840472c4aeb8a0a5f2a5dfad975', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:45:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Creating image(s)
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.213s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk 1073741824" returned: 0 in 0.045s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Cannot resize image /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Ensure instance console log exists: /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Successfully created port: 3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26163373663386630', 'path': '/dev/sde'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163373663386630', 'path': '/dev/sde'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lazy-loading 'pci_devices' on Instance uuid 772ff868-f9c9-4cbf-a100-c57b3f5de48b {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:45:34 user nova-compute[74441]:   <uuid>772ff868-f9c9-4cbf-a100-c57b3f5de48b</uuid>
Nov 09 00:45:34 user nova-compute[74441]:   <name>instance-0000000c</name>
Nov 09 00:45:34 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:45:34 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:45:34 user nova-compute[74441]:   <metadata>
Nov 09 00:45:34 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:45:34 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:45:34 user nova-compute[74441]:       <nova:name>tempest-device-tagging-server-1267129226</nova:name>
Nov 09 00:45:34 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:45:29</nova:creationTime>
Nov 09 00:45:34 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:45:34 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:45:34 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:45:34 user nova-compute[74441]:       <nova:owner>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:user uuid="5600a163b7af47d6b59480bd54e0f4e7">tempest-TaggedBootDevicesTest_v242-1062975088-project-member</nova:user>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:project uuid="7674f3c6c6be458bab6baf5195da1f27">tempest-TaggedBootDevicesTest_v242-1062975088</nova:project>
Nov 09 00:45:34 user nova-compute[74441]:       </nova:owner>
Nov 09 00:45:34 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:45:34 user nova-compute[74441]:       <nova:ports>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="438936fd-f9fa-4b7a-b34d-52c4ca8da721">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="7a2f3f39-a5bb-4699-b744-dd695d1904cd">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="b0e68402-e24d-45e4-afac-b6e9a59ef02d">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="4f896c9d-ea07-468f-9f6a-94c6702c3de6">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="127accf4-df28-4e47-991c-09a2571517be">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="2f74a5a7-b670-45f8-947e-b5da91660635">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:         <nova:port uuid="e1abb294-bcf6-4f45-a942-a35f4f19e6f7">
Nov 09 00:45:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 09 00:45:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:34 user nova-compute[74441]:       </nova:ports>
Nov 09 00:45:34 user nova-compute[74441]:     </nova:instance>
Nov 09 00:45:34 user nova-compute[74441]:   </metadata>
Nov 09 00:45:34 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:45:34 user nova-compute[74441]:     <system>
Nov 09 00:45:34 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:45:34 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:45:34 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:45:34 user nova-compute[74441]:       <entry name="serial">772ff868-f9c9-4cbf-a100-c57b3f5de48b</entry>
Nov 09 00:45:34 user nova-compute[74441]:       <entry name="uuid">772ff868-f9c9-4cbf-a100-c57b3f5de48b</entry>
Nov 09 00:45:34 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:45:34 user nova-compute[74441]:     </system>
Nov 09 00:45:34 user nova-compute[74441]:   </sysinfo>
Nov 09 00:45:34 user nova-compute[74441]:   <os>
Nov 09 00:45:34 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:45:34 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:45:34 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:45:34 user nova-compute[74441]:   </os>
Nov 09 00:45:34 user nova-compute[74441]:   <features>
Nov 09 00:45:34 user nova-compute[74441]:     <acpi/>
Nov 09 00:45:34 user nova-compute[74441]:     <apic/>
Nov 09 00:45:34 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:45:34 user nova-compute[74441]:   </features>
Nov 09 00:45:34 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:45:34 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:45:34 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:45:34 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:45:34 user nova-compute[74441]:   </clock>
Nov 09 00:45:34 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:45:34 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:45:34 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:45:34 user nova-compute[74441]:   </cpu>
Nov 09 00:45:34 user nova-compute[74441]:   <devices>
Nov 09 00:45:34 user nova-compute[74441]:     <disk type="file" device="cdrom">
Nov 09 00:45:34 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 00:45:34 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b/disk.config"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="hda" bus="ide"/>
Nov 09 00:45:34 user nova-compute[74441]:     </disk>
Nov 09 00:45:34 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:45:34 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:45:34 user nova-compute[74441]:       <source dev="/dev/sdc"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <serial>7180e750-8d04-442f-9e73-d07278f76b8b</serial>
Nov 09 00:45:34 user nova-compute[74441]:     </disk>
Nov 09 00:45:34 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:45:34 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:45:34 user nova-compute[74441]:       <source dev="/dev/sdd"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <serial>ff0fbada-4331-4d52-8e14-2eac745a702a</serial>
Nov 09 00:45:34 user nova-compute[74441]:     </disk>
Nov 09 00:45:34 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:45:34 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:45:34 user nova-compute[74441]:       <source dev="/dev/sde"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="vdc" bus="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <serial>6d420062-7515-4f85-929e-46746d11cfcf</serial>
Nov 09 00:45:34 user nova-compute[74441]:     </disk>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:3c:cc:e6"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tap438936fd-f9"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:10:13:ae"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tap7a2f3f39-a5"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:4b:cf:69"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tapb0e68402-e2"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:72:ee:e3"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tap4f896c9d-ea"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:fd:53:e9"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tap127accf4-df"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:ab:4e:af"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tap2f74a5a7-b6"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:34 user nova-compute[74441]:       <mac address="fa:16:3e:69:77:7a"/>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:34 user nova-compute[74441]:       <target dev="tape1abb294-bc"/>
Nov 09 00:45:34 user nova-compute[74441]:     </interface>
Nov 09 00:45:34 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:45:34 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b/console.log" append="off"/>
Nov 09 00:45:34 user nova-compute[74441]:     </serial>
Nov 09 00:45:34 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:45:34 user nova-compute[74441]:     <video>
Nov 09 00:45:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:34 user nova-compute[74441]:     </video>
Nov 09 00:45:34 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:45:34 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:45:34 user nova-compute[74441]:     </rng>
Nov 09 00:45:34 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:45:34 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:45:34 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:45:34 user nova-compute[74441]:     </memballoon>
Nov 09 00:45:34 user nova-compute[74441]:   </devices>
Nov 09 00:45:34 user nova-compute[74441]: </domain>
Nov 09 00:45:34 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94e3b7cc-53c8-51d0-8d64-89a390bb5f96', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap438936fd-f9, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap438936fd-f9, col_values=(('qos', UUID('10fce713-5a9e-41f9-af30-3b16524672bf')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap438936fd-f9, col_values=(('external_ids', {'iface-id': '438936fd-f9fa-4b7a-b34d-52c4ca8da721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:cc:e6', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee501894-3b02-532c-9a5c-61afadfa67d0', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a2f3f39-a5, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a2f3f39-a5, col_values=(('qos', UUID('48e18531-1f06-458e-9519-d518fc251735')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a2f3f39-a5, col_values=(('external_ids', {'iface-id': '7a2f3f39-a5bb-4699-b744-dd695d1904cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:13:ae', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '401c189b-a5b9-5d36-b6b0-4cfc849043a8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0e68402-e2, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0e68402-e2, col_values=(('qos', UUID('f2e053b1-095a-43f0-a9a6-90291ab79e78')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0e68402-e2, col_values=(('external_ids', {'iface-id': 'b0e68402-e24d-45e4-afac-b6e9a59ef02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:cf:69', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9109ae26-1168-5615-9374-298cbad5a0a1', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f896c9d-ea, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f896c9d-ea, col_values=(('qos', UUID('d8c31fef-80a3-4786-ad9b-26294ad8ed69')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f896c9d-ea, col_values=(('external_ids', {'iface-id': '4f896c9d-ea07-468f-9f6a-94c6702c3de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:ee:e3', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cc93ce7-b7cd-50f9-b86d-5b0e899a151e', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap127accf4-df, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap127accf4-df, col_values=(('qos', UUID('c27f0818-6093-4012-ad26-93461b435d22')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap127accf4-df, col_values=(('external_ids', {'iface-id': '127accf4-df28-4e47-991c-09a2571517be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:53:e9', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcefc61b-aedc-5dc6-92db-2da976dc932a', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f74a5a7-b6, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f74a5a7-b6, col_values=(('qos', UUID('42366838-9848-499b-bb80-53a4da20f936')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f74a5a7-b6, col_values=(('external_ids', {'iface-id': '2f74a5a7-b670-45f8-947e-b5da91660635', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:4e:af', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddbcf8b0-ba04-539f-9800-72806425368e', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Successfully updated port: 3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1abb294-bc, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1abb294-bc, col_values=(('qos', UUID('c17ecb8f-28a7-45d7-820b-c23f2ef943a0')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1abb294-bc, col_values=(('external_ids', {'iface-id': 'e1abb294-bcf6-4f45-a942-a35f4f19e6f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:77:7a', 'vm-uuid': '772ff868-f9c9-4cbf-a100-c57b3f5de48b'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing instance network info cache due to event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:34 user nova-compute[74441]: INFO os_vif [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc')
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] No BDM found with device name hda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] No VIF found with MAC fa:16:3e:3c:cc:e6, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:45:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] No VIF found with MAC fa:16:3e:fd:53:e9, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:45:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Using config drive
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance network_info: |[{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Start _get_guest_xml network_info=[{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:45:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:45:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930618791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930618791',id=17,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMb25zfN3py8mmIpkXkL3rIxaATH7Epy6brvS8jLPf+74doXpIjBdQhF1yatgMPiUzJKmKnY+j+D6u5fH6q/+Kj3HziZBHsf85iUJmlqOQOCEiUJM9mj+NqMXycwse9Fw==',key_name='tempest-keypair-1628763909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-90qwe0d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=6a1f838d-1157-43c3-9e63-3fbd698d1916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:45:35 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Creating config drive at /opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b/disk.config
Nov 09 00:45:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp64hjhgyi {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:45:35 user nova-compute[74441]:   <uuid>6a1f838d-1157-43c3-9e63-3fbd698d1916</uuid>
Nov 09 00:45:35 user nova-compute[74441]:   <name>instance-00000011</name>
Nov 09 00:45:35 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:45:35 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:45:35 user nova-compute[74441]:   <metadata>
Nov 09 00:45:35 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:45:35 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:45:35 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-930618791</nova:name>
Nov 09 00:45:35 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:45:35</nova:creationTime>
Nov 09 00:45:35 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:45:35 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:45:35 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:45:35 user nova-compute[74441]:       <nova:owner>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:user uuid="e8b687249f4d41d680915f2d30fc8dbd">tempest-AttachVolumeShelveTestJSON-1580389683-project-member</nova:user>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:project uuid="6f51b840472c4aeb8a0a5f2a5dfad975">tempest-AttachVolumeShelveTestJSON-1580389683</nova:project>
Nov 09 00:45:35 user nova-compute[74441]:       </nova:owner>
Nov 09 00:45:35 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:45:35 user nova-compute[74441]:       <nova:ports>
Nov 09 00:45:35 user nova-compute[74441]:         <nova:port uuid="3a68cef1-a700-4e1d-9b90-cc4b6937a178">
Nov 09 00:45:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 00:45:35 user nova-compute[74441]:         </nova:port>
Nov 09 00:45:35 user nova-compute[74441]:       </nova:ports>
Nov 09 00:45:35 user nova-compute[74441]:     </nova:instance>
Nov 09 00:45:35 user nova-compute[74441]:   </metadata>
Nov 09 00:45:35 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:45:35 user nova-compute[74441]:     <system>
Nov 09 00:45:35 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:45:35 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:45:35 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:45:35 user nova-compute[74441]:       <entry name="serial">6a1f838d-1157-43c3-9e63-3fbd698d1916</entry>
Nov 09 00:45:35 user nova-compute[74441]:       <entry name="uuid">6a1f838d-1157-43c3-9e63-3fbd698d1916</entry>
Nov 09 00:45:35 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:45:35 user nova-compute[74441]:     </system>
Nov 09 00:45:35 user nova-compute[74441]:   </sysinfo>
Nov 09 00:45:35 user nova-compute[74441]:   <os>
Nov 09 00:45:35 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:45:35 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:45:35 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:45:35 user nova-compute[74441]:   </os>
Nov 09 00:45:35 user nova-compute[74441]:   <features>
Nov 09 00:45:35 user nova-compute[74441]:     <acpi/>
Nov 09 00:45:35 user nova-compute[74441]:     <apic/>
Nov 09 00:45:35 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:45:35 user nova-compute[74441]:   </features>
Nov 09 00:45:35 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:45:35 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:45:35 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:45:35 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:45:35 user nova-compute[74441]:   </clock>
Nov 09 00:45:35 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:45:35 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:45:35 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:45:35 user nova-compute[74441]:   </cpu>
Nov 09 00:45:35 user nova-compute[74441]:   <devices>
Nov 09 00:45:35 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:45:35 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:45:35 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk"/>
Nov 09 00:45:35 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:45:35 user nova-compute[74441]:     </disk>
Nov 09 00:45:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:45:35 user nova-compute[74441]:       <mac address="fa:16:3e:5b:95:d3"/>
Nov 09 00:45:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:45:35 user nova-compute[74441]:       <target dev="tap3a68cef1-a7"/>
Nov 09 00:45:35 user nova-compute[74441]:     </interface>
Nov 09 00:45:35 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:45:35 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/console.log" append="off"/>
Nov 09 00:45:35 user nova-compute[74441]:     </serial>
Nov 09 00:45:35 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:45:35 user nova-compute[74441]:     <video>
Nov 09 00:45:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:45:35 user nova-compute[74441]:     </video>
Nov 09 00:45:35 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:45:35 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:45:35 user nova-compute[74441]:     </rng>
Nov 09 00:45:35 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:45:35 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:45:35 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:45:35 user nova-compute[74441]:     </memballoon>
Nov 09 00:45:35 user nova-compute[74441]:   </devices>
Nov 09 00:45:35 user nova-compute[74441]: </domain>
Nov 09 00:45:35 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930618791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930618791',id=17,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMb25zfN3py8mmIpkXkL3rIxaATH7Epy6brvS8jLPf+74doXpIjBdQhF1yatgMPiUzJKmKnY+j+D6u5fH6q/+Kj3HziZBHsf85iUJmlqOQOCEiUJM9mj+NqMXycwse9Fw==',key_name='tempest-keypair-1628763909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-90qwe0d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=6a1f838d-1157-43c3-9e63-3fbd698d1916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG os_vif [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp64hjhgyi" returned: 0 in 0.098s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9de4b30-c4e0-530e-a8f5-9b1b7acd1671', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a68cef1-a7, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a68cef1-a7, col_values=(('qos', UUID('7c627c5c-a124-4aef-9f88-c5c685841dbe')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a68cef1-a7, col_values=(('external_ids', {'iface-id': '3a68cef1-a700-4e1d-9b90-cc4b6937a178', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:95:d3', 'vm-uuid': '6a1f838d-1157-43c3-9e63-3fbd698d1916'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:35 user nova-compute[74441]: INFO os_vif [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7')
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No VIF found with MAC fa:16:3e:5b:95:d3, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updated VIF entry in instance network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:45:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c21a4ac5-318b-48a4-a8aa-9073189e2e65 req-50c00706-d5f2-4ab0-8f84-3b06507a2571 service nova] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:45:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-7369fe3a-c5bf-439d-8025-a59aac4a08a6 req-26a82e3c-0302-47ed-a8cc-996bf19724fa service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7369fe3a-c5bf-439d-8025-a59aac4a08a6 req-26a82e3c-0302-47ed-a8cc-996bf19724fa service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7369fe3a-c5bf-439d-8025-a59aac4a08a6 req-26a82e3c-0302-47ed-a8cc-996bf19724fa service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7369fe3a-c5bf-439d-8025-a59aac4a08a6 req-26a82e3c-0302-47ed-a8cc-996bf19724fa service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-7369fe3a-c5bf-439d-8025-a59aac4a08a6 req-26a82e3c-0302-47ed-a8cc-996bf19724fa service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:38 user nova-compute[74441]: WARNING nova.compute.manager [req-7369fe3a-c5bf-439d-8025-a59aac4a08a6 req-26a82e3c-0302-47ed-a8cc-996bf19724fa service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 for instance with vm_state building and task_state spawning.
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-698ce0d8-2e55-4f2c-b583-c410e3c94040 req-8397e926-2b38-4508-af5b-60bf53ff3050 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-698ce0d8-2e55-4f2c-b583-c410e3c94040 req-8397e926-2b38-4508-af5b-60bf53ff3050 service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-698ce0d8-2e55-4f2c-b583-c410e3c94040 req-8397e926-2b38-4508-af5b-60bf53ff3050 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-698ce0d8-2e55-4f2c-b583-c410e3c94040 req-8397e926-2b38-4508-af5b-60bf53ff3050 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-698ce0d8-2e55-4f2c-b583-c410e3c94040 req-8397e926-2b38-4508-af5b-60bf53ff3050 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:38 user nova-compute[74441]: WARNING nova.compute.manager [req-698ce0d8-2e55-4f2c-b583-c410e3c94040 req-8397e926-2b38-4508-af5b-60bf53ff3050 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state building and task_state spawning.
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-d47f4ea7-b8b6-4fa8-925d-25d5a602586d req-01ff8352-7586-4c48-9f55-371ac644988b service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d47f4ea7-b8b6-4fa8-925d-25d5a602586d req-01ff8352-7586-4c48-9f55-371ac644988b service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d47f4ea7-b8b6-4fa8-925d-25d5a602586d req-01ff8352-7586-4c48-9f55-371ac644988b service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d47f4ea7-b8b6-4fa8-925d-25d5a602586d req-01ff8352-7586-4c48-9f55-371ac644988b service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-d47f4ea7-b8b6-4fa8-925d-25d5a602586d req-01ff8352-7586-4c48-9f55-371ac644988b service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:38 user nova-compute[74441]: WARNING nova.compute.manager [req-d47f4ea7-b8b6-4fa8-925d-25d5a602586d req-01ff8352-7586-4c48-9f55-371ac644988b service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd for instance with vm_state building and task_state spawning.
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-1ec5674e-5f4b-4e6b-9b85-e5c3ea42315d req-a8234d90-87aa-4392-8c68-e81eba319717 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1ec5674e-5f4b-4e6b-9b85-e5c3ea42315d req-a8234d90-87aa-4392-8c68-e81eba319717 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1ec5674e-5f4b-4e6b-9b85-e5c3ea42315d req-a8234d90-87aa-4392-8c68-e81eba319717 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1ec5674e-5f4b-4e6b-9b85-e5c3ea42315d req-a8234d90-87aa-4392-8c68-e81eba319717 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-1ec5674e-5f4b-4e6b-9b85-e5c3ea42315d req-a8234d90-87aa-4392-8c68-e81eba319717 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-1ec5674e-5f4b-4e6b-9b85-e5c3ea42315d req-a8234d90-87aa-4392-8c68-e81eba319717 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-278a96a1-4cf0-485e-8b99-5a690bc30fea req-c8a662c2-3620-45a8-8b11-80834858a822 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:40 user nova-compute[74441]: WARNING nova.compute.manager [req-dcd30859-17af-41e2-be11-2da6ae0c61f5 req-f8f6eb8b-b5ee-4a42-9ca6-4b49f75fb0e0 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be for instance with vm_state building and task_state spawning.
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:45:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance spawned successfully.
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:41 user nova-compute[74441]: INFO nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Took 8.76 seconds to spawn the instance on the hypervisor.
Nov 09 00:45:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:45:41 user nova-compute[74441]: INFO nova.compute.manager [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Took 9.67 seconds to build instance.
Nov 09 00:45:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5b100f2e-a9ca-4667-82bf-7918f9a66750 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.822s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:42 user nova-compute[74441]: WARNING nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 for instance with vm_state building and task_state spawning.
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:42 user nova-compute[74441]: WARNING nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 for instance with vm_state building and task_state spawning.
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:42 user nova-compute[74441]: WARNING nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 for instance with vm_state building and task_state spawning.
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:45:42 user nova-compute[74441]: WARNING nova.compute.manager [req-15b7fad6-b264-4eff-9692-0e6e6a82317b req-174808bc-fa03-4bc3-9b9e-cbd3db53afea service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 for instance with vm_state building and task_state spawning.
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:45:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance spawned successfully.
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:45:43 user nova-compute[74441]: INFO nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Took 13.36 seconds to spawn the instance on the hypervisor.
Nov 09 00:45:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:45:43 user nova-compute[74441]: INFO nova.compute.manager [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Took 141.01 seconds to build instance.
Nov 09 00:45:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1cfd6674-57f5-434d-b26d-2dfb8ac86a0e tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 141.162s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 66.112s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:43 user nova-compute[74441]: INFO nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 09 00:45:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:45:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:45:54 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:45:54 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=25.352828979492188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 772ff868-f9c9-4cbf-a100-c57b3f5de48b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a1f838d-1157-43c3-9e63-3fbd698d1916 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:45:54 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:45:55 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:45:55 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:45:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:45:55 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:45:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:45:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:45:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:45:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:46:05 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:46:05 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:46:05 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb2a858-21d6-4dfa-936a-9e123f65ee7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:46:05 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4924e94-78ab-4859-8a1a-48041d3529bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc] added
Nov 09 00:46:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d10190e-c438-483a-bdbd-d2c1017ec70b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfba579-226e-4183-99b3-00e96523f65b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syDJSNRf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syDJSNRf" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a708ea-1074-44c7-ae4a-7861883bd742]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syDJSNRf'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7bd093-d9c0-44f8-8a1c-8dce561cf041]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e23cfd-487d-4c6b-83a4-4c77aa36da67]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2329732b-fa7f-4e5f-8069-7eaf893db306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]
Nov 09 00:46:05 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.
Nov 09 00:46:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3801a7-83f3-45c6-aa5b-1828e2478391]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6878b973-e0b0-4396-835b-9839543a15c9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:05 user nova-compute[74441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:05 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2970b8e9-0c57-4902-9687-6d6ec6b82da3]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:46:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:46:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:46:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23062333061363963', 'path': '/dev/sdf'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:46:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062333061363963', 'path': '/dev/sdf'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:46:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'flavor' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:46:06 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:46:06 user nova-compute[74441]:   <source dev="/dev/sdf"/>
Nov 09 00:46:06 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:46:06 user nova-compute[74441]:   <serial>84051cd9-ed96-413b-8135-fa3611cde4dc</serial>
Nov 09 00:46:06 user nova-compute[74441]: </disk>
Nov 09 00:46:06 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:46:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:46:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:46:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No VIF found with MAC fa:16:3e:7d:49:fc, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:46:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-03e7e613-4f08-4ffb-b32a-1d5a2483923d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.495s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:46:10 user nova-compute[74441]: INFO nova.compute.claims [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Claim successful on node user
Nov 09 00:46:10 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:46:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.network.neutron [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:46:11 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:46:11 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Creating image(s)
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.policy [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '383f477236d64d908d2a2868166d4107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b21e08a84834a8eb02dc374bb92b647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:46:11 user nova-compute[74441]: INFO nova.compute.claims [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Claim successful on node user
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.458s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk 1073741824" returned: 0 in 0.064s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Successfully created port: 4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.139s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Cannot resize image /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Ensure instance console log exists: /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:46:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:46:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Creating image(s)
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG nova.policy [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '383f477236d64d908d2a2868166d4107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b21e08a84834a8eb02dc374bb92b647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.229s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk 1073741824" returned: 0 in 0.071s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Successfully updated port: 4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-changed-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Refreshing instance network info cache due to event network-changed-4b49fc37-2df4-4265-99be-94e5b5a8aa99. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.network.neutron [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Refreshing network info cache for port 4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Successfully created port: 125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.network.neutron [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Cannot resize image /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Ensure instance console log exists: /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d98d8b86-70d6-4acb-8dfd-682fdde2449c req-59abbcca-632d-4a3a-9010-3ec4a446408f service nova] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance network_info: |[{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Start _get_guest_xml network_info=[{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:46:14 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:14 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656914458',display_name='tempest-ServerRescueNegativeTestJSON-server-1656914458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656914458',id=18,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-zooi39sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:11Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=ef0e47ba-765a-456e-b9ea-6b7239c86820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.objects.instance [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'pci_devices' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Successfully updated port: 125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-changed-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Refreshing instance network info cache due to event network-changed-5afd2159-15d0-410e-9778-eb2b0c3c962c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] Acquiring lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] Acquired lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Refreshing network info cache for port 5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:46:14 user nova-compute[74441]:   <uuid>ef0e47ba-765a-456e-b9ea-6b7239c86820</uuid>
Nov 09 00:46:14 user nova-compute[74441]:   <name>instance-00000012</name>
Nov 09 00:46:14 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:46:14 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:46:14 user nova-compute[74441]:   <metadata>
Nov 09 00:46:14 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:46:14 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:46:14 user nova-compute[74441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1656914458</nova:name>
Nov 09 00:46:14 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:46:14</nova:creationTime>
Nov 09 00:46:14 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:46:14 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:46:14 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:46:14 user nova-compute[74441]:       <nova:owner>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:user uuid="383f477236d64d908d2a2868166d4107">tempest-ServerRescueNegativeTestJSON-1883004734-project-member</nova:user>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:project uuid="0b21e08a84834a8eb02dc374bb92b647">tempest-ServerRescueNegativeTestJSON-1883004734</nova:project>
Nov 09 00:46:14 user nova-compute[74441]:       </nova:owner>
Nov 09 00:46:14 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:46:14 user nova-compute[74441]:       <nova:ports>
Nov 09 00:46:14 user nova-compute[74441]:         <nova:port uuid="4b49fc37-2df4-4265-99be-94e5b5a8aa99">
Nov 09 00:46:14 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 00:46:14 user nova-compute[74441]:         </nova:port>
Nov 09 00:46:14 user nova-compute[74441]:       </nova:ports>
Nov 09 00:46:14 user nova-compute[74441]:     </nova:instance>
Nov 09 00:46:14 user nova-compute[74441]:   </metadata>
Nov 09 00:46:14 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:46:14 user nova-compute[74441]:     <system>
Nov 09 00:46:14 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:46:14 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:46:14 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:46:14 user nova-compute[74441]:       <entry name="serial">ef0e47ba-765a-456e-b9ea-6b7239c86820</entry>
Nov 09 00:46:14 user nova-compute[74441]:       <entry name="uuid">ef0e47ba-765a-456e-b9ea-6b7239c86820</entry>
Nov 09 00:46:14 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:46:14 user nova-compute[74441]:     </system>
Nov 09 00:46:14 user nova-compute[74441]:   </sysinfo>
Nov 09 00:46:14 user nova-compute[74441]:   <os>
Nov 09 00:46:14 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:46:14 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:46:14 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:46:14 user nova-compute[74441]:   </os>
Nov 09 00:46:14 user nova-compute[74441]:   <features>
Nov 09 00:46:14 user nova-compute[74441]:     <acpi/>
Nov 09 00:46:14 user nova-compute[74441]:     <apic/>
Nov 09 00:46:14 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:46:14 user nova-compute[74441]:   </features>
Nov 09 00:46:14 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:46:14 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:46:14 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:46:14 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:46:14 user nova-compute[74441]:   </clock>
Nov 09 00:46:14 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:46:14 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:46:14 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:46:14 user nova-compute[74441]:   </cpu>
Nov 09 00:46:14 user nova-compute[74441]:   <devices>
Nov 09 00:46:14 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:46:14 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:46:14 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk"/>
Nov 09 00:46:14 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:46:14 user nova-compute[74441]:     </disk>
Nov 09 00:46:14 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:46:14 user nova-compute[74441]:       <mac address="fa:16:3e:4c:42:d5"/>
Nov 09 00:46:14 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:14 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:46:14 user nova-compute[74441]:       <target dev="tap4b49fc37-2d"/>
Nov 09 00:46:14 user nova-compute[74441]:     </interface>
Nov 09 00:46:14 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:46:14 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/console.log" append="off"/>
Nov 09 00:46:14 user nova-compute[74441]:     </serial>
Nov 09 00:46:14 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:46:14 user nova-compute[74441]:     <video>
Nov 09 00:46:14 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:14 user nova-compute[74441]:     </video>
Nov 09 00:46:14 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:46:14 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:46:14 user nova-compute[74441]:     </rng>
Nov 09 00:46:14 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:46:14 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:46:14 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:46:14 user nova-compute[74441]:     </memballoon>
Nov 09 00:46:14 user nova-compute[74441]:   </devices>
Nov 09 00:46:14 user nova-compute[74441]: </domain>
Nov 09 00:46:14 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656914458',display_name='tempest-ServerRescueNegativeTestJSON-server-1656914458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656914458',id=18,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-zooi39sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:11Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=ef0e47ba-765a-456e-b9ea-6b7239c86820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG os_vif [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-changed-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Refreshing instance network info cache due to event network-changed-125829c5-3b93-4c47-8cf7-bb293cc53cd1. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] Acquiring lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] Acquired lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Refreshing network info cache for port 125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c435c783-e504-5afc-9f0b-5b45a135775e', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b49fc37-2d, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b49fc37-2d, col_values=(('qos', UUID('39f450c8-e6a4-4594-ab6a-5d55fde92932')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b49fc37-2d, col_values=(('external_ids', {'iface-id': '4b49fc37-2df4-4265-99be-94e5b5a8aa99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:42:d5', 'vm-uuid': 'ef0e47ba-765a-456e-b9ea-6b7239c86820'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:14 user nova-compute[74441]: INFO os_vif [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d')
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:4c:42:d5, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ff48421d-bba1-4358-b16f-0e753935b1b9 req-7ccf300d-44cb-40e5-8471-0232df65fc49 service nova] Releasing lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:46:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.neutron [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updated VIF entry in instance network info cache for port 5afd2159-15d0-410e-9778-eb2b0c3c962c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.neutron [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating instance_info_cache with network_info: [{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5e285593-bd94-4711-8766-fa19d7ec37d5 req-ab85db5c-5985-4541-91e4-600df756bf51 service nova] Releasing lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updating instance_info_cache with network_info: [{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance network_info: |[{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Start _get_guest_xml network_info=[{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:46:15 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:15 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656089628',display_name='tempest-ServerRescueNegativeTestJSON-server-1656089628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656089628',id=19,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-khe0d14u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:13Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=b5e4c1f2-f309-48b5-93aa-2bfdb8f31856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'pci_devices' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:46:15 user nova-compute[74441]:   <uuid>b5e4c1f2-f309-48b5-93aa-2bfdb8f31856</uuid>
Nov 09 00:46:15 user nova-compute[74441]:   <name>instance-00000013</name>
Nov 09 00:46:15 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:46:15 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:46:15 user nova-compute[74441]:   <metadata>
Nov 09 00:46:15 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:46:15 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:46:15 user nova-compute[74441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1656089628</nova:name>
Nov 09 00:46:15 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:46:15</nova:creationTime>
Nov 09 00:46:15 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:46:15 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:46:15 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:46:15 user nova-compute[74441]:       <nova:owner>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:user uuid="383f477236d64d908d2a2868166d4107">tempest-ServerRescueNegativeTestJSON-1883004734-project-member</nova:user>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:project uuid="0b21e08a84834a8eb02dc374bb92b647">tempest-ServerRescueNegativeTestJSON-1883004734</nova:project>
Nov 09 00:46:15 user nova-compute[74441]:       </nova:owner>
Nov 09 00:46:15 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:46:15 user nova-compute[74441]:       <nova:ports>
Nov 09 00:46:15 user nova-compute[74441]:         <nova:port uuid="125829c5-3b93-4c47-8cf7-bb293cc53cd1">
Nov 09 00:46:15 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:46:15 user nova-compute[74441]:         </nova:port>
Nov 09 00:46:15 user nova-compute[74441]:       </nova:ports>
Nov 09 00:46:15 user nova-compute[74441]:     </nova:instance>
Nov 09 00:46:15 user nova-compute[74441]:   </metadata>
Nov 09 00:46:15 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:46:15 user nova-compute[74441]:     <system>
Nov 09 00:46:15 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:46:15 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:46:15 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:46:15 user nova-compute[74441]:       <entry name="serial">b5e4c1f2-f309-48b5-93aa-2bfdb8f31856</entry>
Nov 09 00:46:15 user nova-compute[74441]:       <entry name="uuid">b5e4c1f2-f309-48b5-93aa-2bfdb8f31856</entry>
Nov 09 00:46:15 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:46:15 user nova-compute[74441]:     </system>
Nov 09 00:46:15 user nova-compute[74441]:   </sysinfo>
Nov 09 00:46:15 user nova-compute[74441]:   <os>
Nov 09 00:46:15 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:46:15 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:46:15 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:46:15 user nova-compute[74441]:   </os>
Nov 09 00:46:15 user nova-compute[74441]:   <features>
Nov 09 00:46:15 user nova-compute[74441]:     <acpi/>
Nov 09 00:46:15 user nova-compute[74441]:     <apic/>
Nov 09 00:46:15 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:46:15 user nova-compute[74441]:   </features>
Nov 09 00:46:15 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:46:15 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:46:15 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:46:15 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:46:15 user nova-compute[74441]:   </clock>
Nov 09 00:46:15 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:46:15 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:46:15 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:46:15 user nova-compute[74441]:   </cpu>
Nov 09 00:46:15 user nova-compute[74441]:   <devices>
Nov 09 00:46:15 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:46:15 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:46:15 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk"/>
Nov 09 00:46:15 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:46:15 user nova-compute[74441]:     </disk>
Nov 09 00:46:15 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:46:15 user nova-compute[74441]:       <mac address="fa:16:3e:fe:bf:c8"/>
Nov 09 00:46:15 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:15 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:46:15 user nova-compute[74441]:       <target dev="tap125829c5-3b"/>
Nov 09 00:46:15 user nova-compute[74441]:     </interface>
Nov 09 00:46:15 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:46:15 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/console.log" append="off"/>
Nov 09 00:46:15 user nova-compute[74441]:     </serial>
Nov 09 00:46:15 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:46:15 user nova-compute[74441]:     <video>
Nov 09 00:46:15 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:15 user nova-compute[74441]:     </video>
Nov 09 00:46:15 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:46:15 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:46:15 user nova-compute[74441]:     </rng>
Nov 09 00:46:15 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:46:15 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:46:15 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:46:15 user nova-compute[74441]:     </memballoon>
Nov 09 00:46:15 user nova-compute[74441]:   </devices>
Nov 09 00:46:15 user nova-compute[74441]: </domain>
Nov 09 00:46:15 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656089628',display_name='tempest-ServerRescueNegativeTestJSON-server-1656089628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656089628',id=19,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-khe0d14u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:13Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=b5e4c1f2-f309-48b5-93aa-2bfdb8f31856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG os_vif [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1610ce21-f762-5374-a9ee-37680d4683b6', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap125829c5-3b, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap125829c5-3b, col_values=(('qos', UUID('902b1c27-3fed-4e5e-aa7c-c85d74dab776')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap125829c5-3b, col_values=(('external_ids', {'iface-id': '125829c5-3b93-4c47-8cf7-bb293cc53cd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:bf:c8', 'vm-uuid': 'b5e4c1f2-f309-48b5-93aa-2bfdb8f31856'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:15 user nova-compute[74441]: INFO os_vif [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b')
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:46:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:fe:bf:c8, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:46:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-67d4763f-9a7b-4b1c-889d-aa91143b268e req-55e952f5-a505-400c-ac13-fa4f995adb9f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-67d4763f-9a7b-4b1c-889d-aa91143b268e req-55e952f5-a505-400c-ac13-fa4f995adb9f service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-67d4763f-9a7b-4b1c-889d-aa91143b268e req-55e952f5-a505-400c-ac13-fa4f995adb9f service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-67d4763f-9a7b-4b1c-889d-aa91143b268e req-55e952f5-a505-400c-ac13-fa4f995adb9f service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-67d4763f-9a7b-4b1c-889d-aa91143b268e req-55e952f5-a505-400c-ac13-fa4f995adb9f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:17 user nova-compute[74441]: WARNING nova.compute.manager [req-67d4763f-9a7b-4b1c-889d-aa91143b268e req-55e952f5-a505-400c-ac13-fa4f995adb9f service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state building and task_state spawning.
Nov 09 00:46:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-changed-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Refreshing instance network info cache due to event network-changed-84b58c57-9620-47d6-80c3-af900e6db54a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] Acquiring lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] Acquired lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Refreshing network info cache for port 84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:18 user nova-compute[74441]: INFO nova.compute.manager [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Shelve offloading
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updated VIF entry in instance network info cache for port 84b58c57-9620-47d6-80c3-af900e6db54a. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating instance_info_cache with network_info: [{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a9693d30-e985-4803-8c05-0d345e6def73 req-494a2864-db87-4862-b249-20338e5dd2f3 service nova] Releasing lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance destroyed successfully.
Nov 09 00:46:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquired lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:19 user nova-compute[74441]: WARNING nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state building and task_state spawning.
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-vif-unplugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] No waiting events found dispatching network-vif-unplugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:19 user nova-compute[74441]: WARNING nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received unexpected event network-vif-unplugged-84b58c57-9620-47d6-80c3-af900e6db54a for instance with vm_state active and task_state shelving.
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] No waiting events found dispatching network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:19 user nova-compute[74441]: WARNING nova.compute.manager [req-f9cd51b6-640b-4c3e-b420-6a1976a559a6 req-f4e0175c-3dab-41e6-9a41-e3959ddbcdd9 service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received unexpected event network-vif-plugged-84b58c57-9620-47d6-80c3-af900e6db54a for instance with vm_state active and task_state shelving.
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating instance_info_cache with network_info: [{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:19 user nova-compute[74441]: WARNING nova.compute.manager [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state building and task_state spawning.
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:19 user nova-compute[74441]: WARNING nova.compute.manager [req-46403b75-d985-44d6-832c-34b1c5c9cd49 req-470a2ac1-18e4-4053-8bde-b38ba52840c1 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state building and task_state spawning.
Nov 09 00:46:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Releasing lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance destroyed successfully.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.objects.instance [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lazy-loading 'resources' on Instance uuid bf7c7bb1-037c-48a9-9673-b358578fa4eb {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-309605040',display_name='tempest-TestShelveInstance-server-309605040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-309605040',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+r1EebhzWODdwxNpuHCbaaB/Iynhmbpl7LKEvpyAdHm7lJ97eJVDP4i3gqE4osK2rK81EWsg+TGGZIMyRTQemF3OkdiV8K34qdKmwuqLlPNOe/fLLbo7NOpwwU7LFeaQ==',key_name='tempest-TestShelveInstance-360366387',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:44:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='759f5f84856747d988ba0d33fe456f4e',ramdisk_id='',reservation_id='r-tu697iy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1685523103',owner_user_name='tempest-TestShelveInstance-1685523103-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:00Z,user_data=None,user_id='714111389c1c4641b4461a684981ad0c',uuid=bf7c7bb1-037c-48a9-9673-b358578fa4eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Converting VIF {"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": "br-int", "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b58c57-96", "ovs_interfaceid": "84b58c57-9620-47d6-80c3-af900e6db54a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_vif [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84b58c57-96, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=899aa5a8-6fe6-4aec-a3c8-0c4c3cfd13fa) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:20 user nova-compute[74441]: INFO os_vif [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a2:ed,bridge_name='br-int',has_traffic_filtering=True,id=84b58c57-9620-47d6-80c3-af900e6db54a,network=Network(9636bde9-3ddf-4b9e-8300-23bbb6a28f5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b58c57-96')
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ROlkEIbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:46:20 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d98e29-78ce-4596-a96f-87c4794f0254]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:46:20 user nova-compute[74441]: No targets found.
Nov 09 00:46:20 user nova-compute[74441]: iSNS:
Nov 09 00:46:20 user nova-compute[74441]: No targets found.
Nov 09 00:46:20 user nova-compute[74441]: STATIC:
Nov 09 00:46:20 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:46:20 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:20 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:20 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b
Nov 09 00:46:20 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:20 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:20 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c
Nov 09 00:46:20 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:20 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:20 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf
Nov 09 00:46:20 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:20 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:20 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a
Nov 09 00:46:20 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:20 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:20 user nova-compute[74441]: FIRMWARE:
Nov 09 00:46:20 user nova-compute[74441]: No targets found.
Nov 09 00:46:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:46:20 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:46:20 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e804b42-294b-439d-a251-1344d6705317]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af5737-6b86-475b-99f6-e6f170737d1f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:20 user nova-compute[74441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c743ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c462c95f-ceeb-49a8-9162-eb4448addac3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[06daa519-376a-44ab-9bf9-3ca398211ad0]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a048207-134b-43a0-9437-cf56810a94ca]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance spawned successfully.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[79716129-84fd-43da-918b-57c82f1b6f12]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e1d679-2a59-4e05-bfbc-b26b6f8d6b26]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Took 9.19 seconds to spawn the instance on the hypervisor.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance spawned successfully.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46319b8-7d97-461f-945c-731ea9851fc1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260]
Nov 09 00:46:20 user nova-compute[74441]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c, portal: 172.16.0.220,3260] successful.
Nov 09 00:46:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d1bdad4-636f-45d3-bde5-7276ef7ada6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9352fd5f-2ba0-4360-a344-285e34be84e9]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] <== disconnect_volume: return (386ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Deleting instance files /opt/stack/data/nova/instances/bf7c7bb1-037c-48a9-9673-b358578fa4eb_del
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Deletion of /opt/stack/data/nova/instances/bf7c7bb1-037c-48a9-9673-b358578fa4eb_del complete
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.compute.manager [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Took 10.08 seconds to build instance.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-291c31e1-310a-4a71-8317-c585ade06b36 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.182s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Took 7.92 seconds to spawn the instance on the hypervisor.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:46:20 user nova-compute[74441]: INFO nova.compute.manager [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Took 9.42 seconds to build instance.
Nov 09 00:46:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9a6bc95a-3480-40b4-a519-d40f51f9d2a9 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.636s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Received event network-changed-84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Refreshing instance network info cache due to event network-changed-84b58c57-9620-47d6-80c3-af900e6db54a. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] Acquiring lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] Acquired lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:21 user nova-compute[74441]: DEBUG nova.network.neutron [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Refreshing network info cache for port 84b58c57-9620-47d6-80c3-af900e6db54a {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:22 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Deleted allocations for instance bf7c7bb1-037c-48a9-9673-b358578fa4eb
Nov 09 00:46:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updated VIF entry in instance network info cache for port 84b58c57-9620-47d6-80c3-af900e6db54a. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating instance_info_cache with network_info: [{"id": "84b58c57-9620-47d6-80c3-af900e6db54a", "address": "fa:16:3e:7f:a2:ed", "network": {"id": "9636bde9-3ddf-4b9e-8300-23bbb6a28f5c", "bridge": null, "label": "tempest-TestShelveInstance-238910051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "759f5f84856747d988ba0d33fe456f4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap84b58c57-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-081934bb-b88d-4800-8809-4f94fb27fdba req-2e2a174f-c63c-4285-b6b8-0bd920dfe51d service nova] Releasing lock "refresh_cache-bf7c7bb1-037c-48a9-9673-b358578fa4eb" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG nova.objects.instance [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lazy-loading 'numa_topology' on Instance uuid bf7c7bb1-037c-48a9-9673-b358578fa4eb {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG nova.objects.base [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Object Instance<bf7c7bb1-037c-48a9-9673-b358578fa4eb> lazy-loaded attributes: resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-06fbac01-97cb-4b92-8104-e955a371abb5 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.455s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing instance network info cache due to event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updated VIF entry in instance network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-eae6ef1f-fee9-4991-a629-fbf1de424ce8 req-1079bf25-93bb-4398-b152-c57450b2b3d5 service nova] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing instance network info cache due to event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG nova.network.neutron [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG nova.network.neutron [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updated VIF entry in instance network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG nova.network.neutron [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-030db4b0-6d3f-4552-b4e1-0fb75577f386 req-76496d1c-83d2-48e2-a0e2-5c18ea6094e1 service nova] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:27 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:46:28 user nova-compute[74441]: INFO nova.compute.claims [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Claim successful on node user
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:46:28 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.policy [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc13355f609c4b089a91c8e4cd68987a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491dac50b8ab4e8cadadeae77c480e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:46:28 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Creating image(s)
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.307s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk 1073741824" returned: 0 in 0.057s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Successfully created port: 22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.212s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Cannot resize image /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Ensure instance console log exists: /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG nova.network.neutron [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Successfully updated port: 22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG nova.network.neutron [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-changed-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Refreshing instance network info cache due to event network-changed-22bdea8e-3969-48d2-bdc9-6e80f00a6542. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:30 user nova-compute[74441]: DEBUG nova.network.neutron [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance network_info: |[{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Refreshing network info cache for port 22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start _get_guest_xml network_info=[{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:46:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'pci_devices' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:46:31 user nova-compute[74441]:   <uuid>670d138e-9fe7-40cc-810f-f88587f03bd8</uuid>
Nov 09 00:46:31 user nova-compute[74441]:   <name>instance-00000014</name>
Nov 09 00:46:31 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:46:31 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:46:31 user nova-compute[74441]:   <metadata>
Nov 09 00:46:31 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:46:31 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:46:31 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherB-server-1638891823</nova:name>
Nov 09 00:46:31 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:46:31</nova:creationTime>
Nov 09 00:46:31 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:46:31 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:46:31 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:46:31 user nova-compute[74441]:       <nova:owner>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:user uuid="fc13355f609c4b089a91c8e4cd68987a">tempest-ServerActionsTestOtherB-965415346-project-member</nova:user>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:project uuid="491dac50b8ab4e8cadadeae77c480e9a">tempest-ServerActionsTestOtherB-965415346</nova:project>
Nov 09 00:46:31 user nova-compute[74441]:       </nova:owner>
Nov 09 00:46:31 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:46:31 user nova-compute[74441]:       <nova:ports>
Nov 09 00:46:31 user nova-compute[74441]:         <nova:port uuid="22bdea8e-3969-48d2-bdc9-6e80f00a6542">
Nov 09 00:46:31 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 00:46:31 user nova-compute[74441]:         </nova:port>
Nov 09 00:46:31 user nova-compute[74441]:       </nova:ports>
Nov 09 00:46:31 user nova-compute[74441]:     </nova:instance>
Nov 09 00:46:31 user nova-compute[74441]:   </metadata>
Nov 09 00:46:31 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:46:31 user nova-compute[74441]:     <system>
Nov 09 00:46:31 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:46:31 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:46:31 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:46:31 user nova-compute[74441]:       <entry name="serial">670d138e-9fe7-40cc-810f-f88587f03bd8</entry>
Nov 09 00:46:31 user nova-compute[74441]:       <entry name="uuid">670d138e-9fe7-40cc-810f-f88587f03bd8</entry>
Nov 09 00:46:31 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:46:31 user nova-compute[74441]:     </system>
Nov 09 00:46:31 user nova-compute[74441]:   </sysinfo>
Nov 09 00:46:31 user nova-compute[74441]:   <os>
Nov 09 00:46:31 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:46:31 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:46:31 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:46:31 user nova-compute[74441]:   </os>
Nov 09 00:46:31 user nova-compute[74441]:   <features>
Nov 09 00:46:31 user nova-compute[74441]:     <acpi/>
Nov 09 00:46:31 user nova-compute[74441]:     <apic/>
Nov 09 00:46:31 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:46:31 user nova-compute[74441]:   </features>
Nov 09 00:46:31 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:46:31 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:46:31 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:46:31 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:46:31 user nova-compute[74441]:   </clock>
Nov 09 00:46:31 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:46:31 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:46:31 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:46:31 user nova-compute[74441]:   </cpu>
Nov 09 00:46:31 user nova-compute[74441]:   <devices>
Nov 09 00:46:31 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:46:31 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:46:31 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk"/>
Nov 09 00:46:31 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:46:31 user nova-compute[74441]:     </disk>
Nov 09 00:46:31 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:46:31 user nova-compute[74441]:       <mac address="fa:16:3e:47:b1:f9"/>
Nov 09 00:46:31 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:31 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:46:31 user nova-compute[74441]:       <target dev="tap22bdea8e-39"/>
Nov 09 00:46:31 user nova-compute[74441]:     </interface>
Nov 09 00:46:31 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:46:31 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/console.log" append="off"/>
Nov 09 00:46:31 user nova-compute[74441]:     </serial>
Nov 09 00:46:31 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:46:31 user nova-compute[74441]:     <video>
Nov 09 00:46:31 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:31 user nova-compute[74441]:     </video>
Nov 09 00:46:31 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:46:31 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:46:31 user nova-compute[74441]:     </rng>
Nov 09 00:46:31 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:46:31 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:46:31 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:46:31 user nova-compute[74441]:     </memballoon>
Nov 09 00:46:31 user nova-compute[74441]:   </devices>
Nov 09 00:46:31 user nova-compute[74441]: </domain>
Nov 09 00:46:31 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG os_vif [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d6ed055-dc89-5da8-8cda-79e0bd76cbd7', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22bdea8e-39, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22bdea8e-39, col_values=(('qos', UUID('73e7ef2b-b0ba-47bf-941b-4f3c1cbdd250')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22bdea8e-39, col_values=(('external_ids', {'iface-id': '22bdea8e-3969-48d2-bdc9-6e80f00a6542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:b1:f9', 'vm-uuid': '670d138e-9fe7-40cc-810f-f88587f03bd8'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:31 user nova-compute[74441]: INFO os_vif [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39')
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No VIF found with MAC fa:16:3e:47:b1:f9, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updated VIF entry in instance network info cache for port 22bdea8e-3969-48d2-bdc9-6e80f00a6542. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-35309476-67dd-47b6-9d49-3c3efec53945 req-bb46e30e-4e6a-453b-9a7e-9e3d4ba7fea9 service nova] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-4a232044-fb14-4654-a06a-5527db1ae4e6 req-abd09909-ee5f-4b31-bd3e-6fe4c9c5f5f1 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4a232044-fb14-4654-a06a-5527db1ae4e6 req-abd09909-ee5f-4b31-bd3e-6fe4c9c5f5f1 service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4a232044-fb14-4654-a06a-5527db1ae4e6 req-abd09909-ee5f-4b31-bd3e-6fe4c9c5f5f1 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4a232044-fb14-4654-a06a-5527db1ae4e6 req-abd09909-ee5f-4b31-bd3e-6fe4c9c5f5f1 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-4a232044-fb14-4654-a06a-5527db1ae4e6 req-abd09909-ee5f-4b31-bd3e-6fe4c9c5f5f1 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:33 user nova-compute[74441]: WARNING nova.compute.manager [req-4a232044-fb14-4654-a06a-5527db1ae4e6 req-abd09909-ee5f-4b31-bd3e-6fe4c9c5f5f1 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state building and task_state spawning.
Nov 09 00:46:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'flavor' on Instance uuid cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:34 user nova-compute[74441]: INFO nova.compute.manager [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Attaching volume acb8a7f2-8533-4bcb-9ed3-839217fa5641 to /dev/vdb
Nov 09 00:46:34 user nova-compute[74441]: DEBUG os_brick.utils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf396aa2-61ff-4b66-8806-904faf443dfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721e055-43ac-4f58-b848-cc6964eb0d9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[164989e6-8efd-403c-845e-509397c2dd0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb12613e-5e1a-4355-a22b-eeba2821adfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:46:34 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:46:34 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5164469-b022-4fcc-b95f-287603399262]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG os_brick.utils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:46:34 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating existing volume attachment record: aca1e6ef-61c6-4cdd-a643-e460ab61d97a {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-e8d3259a-47c8-4601-a0cf-56a43c266ae2 req-024de02f-c42e-4fc4-b431-e6b66ec02c35 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e8d3259a-47c8-4601-a0cf-56a43c266ae2 req-024de02f-c42e-4fc4-b431-e6b66ec02c35 service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e8d3259a-47c8-4601-a0cf-56a43c266ae2 req-024de02f-c42e-4fc4-b431-e6b66ec02c35 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e8d3259a-47c8-4601-a0cf-56a43c266ae2 req-024de02f-c42e-4fc4-b431-e6b66ec02c35 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-e8d3259a-47c8-4601-a0cf-56a43c266ae2 req-024de02f-c42e-4fc4-b431-e6b66ec02c35 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:35 user nova-compute[74441]: WARNING nova.compute.manager [req-e8d3259a-47c8-4601-a0cf-56a43c266ae2 req-024de02f-c42e-4fc4-b431-e6b66ec02c35 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state building and task_state spawning.
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:46:35 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance spawned successfully.
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:35 user nova-compute[74441]: INFO nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Took 6.59 seconds to spawn the instance on the hypervisor.
Nov 09 00:46:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:46:35 user nova-compute[74441]: INFO nova.compute.manager [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Took 7.39 seconds to build instance.
Nov 09 00:46:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-55b94585-47e6-435a-8bfe-613cc2fd59aa tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.503s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-changed-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Refreshing instance network info cache due to event network-changed-184a62e0-be26-4fff-a8f4-927393e2f732. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG nova.network.neutron [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Refreshing network info cache for port 184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:39 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:46:39 user nova-compute[74441]: INFO nova.compute.claims [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Claim successful on node user
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.network.neutron [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updated VIF entry in instance network info cache for port 184a62e0-be26-4fff-a8f4-927393e2f732. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.network.neutron [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bac941fd-e4f6-4e73-bf89-14550785bf19 req-fec79b8c-dc6d-47e6-8852-ada80fe2c624 service nova] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:46:40 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.policy [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8e5ce70bd2b4a01934c18f8e12d89f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fcc87a3fe1470cbae7846b8020ff0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:46:40 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Creating image(s)
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "/opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "/opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "/opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.253s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.276s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk 1073741824" returned: 0 in 0.053s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Successfully created port: 1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Cannot resize image /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Ensure instance console log exists: /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Successfully updated port: 1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "refresh_cache-be2c3dae-92a0-4b70-a253-c74c065afbef" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquired lock "refresh_cache-be2c3dae-92a0-4b70-a253-c74c065afbef" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:41 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-changed-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Refreshing instance network info cache due to event network-changed-1d4536ad-d18e-4c5f-88b3-04dd33732f97. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] Acquiring lock "refresh_cache-be2c3dae-92a0-4b70-a253-c74c065afbef" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Updating instance_info_cache with network_info: [{"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Releasing lock "refresh_cache-be2c3dae-92a0-4b70-a253-c74c065afbef" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Instance network_info: |[{"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] Acquired lock "refresh_cache-be2c3dae-92a0-4b70-a253-c74c065afbef" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.neutron [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Refreshing network info cache for port 1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Start _get_guest_xml network_info=[{"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:46:42 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:42 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-327477545',display_name='tempest-ServersNegativeTestJSON-server-327477545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-327477545',id=21,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1fcc87a3fe1470cbae7846b8020ff0e',ramdisk_id='',reservation_id='r-en1r959s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-296355111',owner_user_name='tempest-ServersNegativeTestJSON-296355111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:41Z,user_data=None,user_id='d8e5ce70bd2b4a01934c18f8e12d89f0',uuid=be2c3dae-92a0-4b70-a253-c74c065afbef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converting VIF {"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lazy-loading 'pci_devices' on Instance uuid be2c3dae-92a0-4b70-a253-c74c065afbef {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:46:42 user nova-compute[74441]:   <uuid>be2c3dae-92a0-4b70-a253-c74c065afbef</uuid>
Nov 09 00:46:42 user nova-compute[74441]:   <name>instance-00000015</name>
Nov 09 00:46:42 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:46:42 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:46:42 user nova-compute[74441]:   <metadata>
Nov 09 00:46:42 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:46:42 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:46:42 user nova-compute[74441]:       <nova:name>tempest-ServersNegativeTestJSON-server-327477545</nova:name>
Nov 09 00:46:42 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:46:42</nova:creationTime>
Nov 09 00:46:42 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:46:42 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:46:42 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:46:42 user nova-compute[74441]:       <nova:owner>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:user uuid="d8e5ce70bd2b4a01934c18f8e12d89f0">tempest-ServersNegativeTestJSON-296355111-project-member</nova:user>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:project uuid="d1fcc87a3fe1470cbae7846b8020ff0e">tempest-ServersNegativeTestJSON-296355111</nova:project>
Nov 09 00:46:42 user nova-compute[74441]:       </nova:owner>
Nov 09 00:46:42 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:46:42 user nova-compute[74441]:       <nova:ports>
Nov 09 00:46:42 user nova-compute[74441]:         <nova:port uuid="1d4536ad-d18e-4c5f-88b3-04dd33732f97">
Nov 09 00:46:42 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 00:46:42 user nova-compute[74441]:         </nova:port>
Nov 09 00:46:42 user nova-compute[74441]:       </nova:ports>
Nov 09 00:46:42 user nova-compute[74441]:     </nova:instance>
Nov 09 00:46:42 user nova-compute[74441]:   </metadata>
Nov 09 00:46:42 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:46:42 user nova-compute[74441]:     <system>
Nov 09 00:46:42 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:46:42 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:46:42 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:46:42 user nova-compute[74441]:       <entry name="serial">be2c3dae-92a0-4b70-a253-c74c065afbef</entry>
Nov 09 00:46:42 user nova-compute[74441]:       <entry name="uuid">be2c3dae-92a0-4b70-a253-c74c065afbef</entry>
Nov 09 00:46:42 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:46:42 user nova-compute[74441]:     </system>
Nov 09 00:46:42 user nova-compute[74441]:   </sysinfo>
Nov 09 00:46:42 user nova-compute[74441]:   <os>
Nov 09 00:46:42 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:46:42 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:46:42 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:46:42 user nova-compute[74441]:   </os>
Nov 09 00:46:42 user nova-compute[74441]:   <features>
Nov 09 00:46:42 user nova-compute[74441]:     <acpi/>
Nov 09 00:46:42 user nova-compute[74441]:     <apic/>
Nov 09 00:46:42 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:46:42 user nova-compute[74441]:   </features>
Nov 09 00:46:42 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:46:42 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:46:42 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:46:42 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:46:42 user nova-compute[74441]:   </clock>
Nov 09 00:46:42 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:46:42 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:46:42 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:46:42 user nova-compute[74441]:   </cpu>
Nov 09 00:46:42 user nova-compute[74441]:   <devices>
Nov 09 00:46:42 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:46:42 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:46:42 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk"/>
Nov 09 00:46:42 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:46:42 user nova-compute[74441]:     </disk>
Nov 09 00:46:42 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:46:42 user nova-compute[74441]:       <mac address="fa:16:3e:3a:2f:ab"/>
Nov 09 00:46:42 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:42 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:46:42 user nova-compute[74441]:       <target dev="tap1d4536ad-d1"/>
Nov 09 00:46:42 user nova-compute[74441]:     </interface>
Nov 09 00:46:42 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:46:42 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/console.log" append="off"/>
Nov 09 00:46:42 user nova-compute[74441]:     </serial>
Nov 09 00:46:42 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:46:42 user nova-compute[74441]:     <video>
Nov 09 00:46:42 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:42 user nova-compute[74441]:     </video>
Nov 09 00:46:42 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:46:42 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:46:42 user nova-compute[74441]:     </rng>
Nov 09 00:46:42 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:46:42 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:46:42 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:46:42 user nova-compute[74441]:     </memballoon>
Nov 09 00:46:42 user nova-compute[74441]:   </devices>
Nov 09 00:46:42 user nova-compute[74441]: </domain>
Nov 09 00:46:42 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-327477545',display_name='tempest-ServersNegativeTestJSON-server-327477545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-327477545',id=21,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1fcc87a3fe1470cbae7846b8020ff0e',ramdisk_id='',reservation_id='r-en1r959s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-296355111',owner_user_name='tempest-ServersNegativeTestJSON-296355111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:41Z,user_data=None,user_id='d8e5ce70bd2b4a01934c18f8e12d89f0',uuid=be2c3dae-92a0-4b70-a253-c74c065afbef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converting VIF {"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG os_vif [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b809750-65f7-5a38-9f02-f7ef6cb0aece', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d4536ad-d1, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d4536ad-d1, col_values=(('qos', UUID('cb94ad8e-5f8c-4186-8804-c6c0bc3c85ca')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d4536ad-d1, col_values=(('external_ids', {'iface-id': '1d4536ad-d18e-4c5f-88b3-04dd33732f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:2f:ab', 'vm-uuid': 'be2c3dae-92a0-4b70-a253-c74c065afbef'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: INFO os_vif [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1')
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] No VIF found with MAC fa:16:3e:3a:2f:ab, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.neutron [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Updated VIF entry in instance network info cache for port 1d4536ad-d18e-4c5f-88b3-04dd33732f97. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG nova.network.neutron [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Updating instance_info_cache with network_info: [{"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-923837e2-fb6c-4ae4-b323-d0cf0462e930 req-14ed3d84-4fcf-42f4-817e-3c973840aa60 service nova] Releasing lock "refresh_cache-be2c3dae-92a0-4b70-a253-c74c065afbef" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3dc172a-1952-4e45-893b-d8b8be269075 req-5f0ca545-e4ce-4ae8-a2c6-40afc7c96220 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3dc172a-1952-4e45-893b-d8b8be269075 req-5f0ca545-e4ce-4ae8-a2c6-40afc7c96220 service nova] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3dc172a-1952-4e45-893b-d8b8be269075 req-5f0ca545-e4ce-4ae8-a2c6-40afc7c96220 service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3dc172a-1952-4e45-893b-d8b8be269075 req-5f0ca545-e4ce-4ae8-a2c6-40afc7c96220 service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3dc172a-1952-4e45-893b-d8b8be269075 req-5f0ca545-e4ce-4ae8-a2c6-40afc7c96220 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] No waiting events found dispatching network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:44 user nova-compute[74441]: WARNING nova.compute.manager [req-f3dc172a-1952-4e45-893b-d8b8be269075 req-5f0ca545-e4ce-4ae8-a2c6-40afc7c96220 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received unexpected event network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 for instance with vm_state building and task_state spawning.
Nov 09 00:46:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:46:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Instance spawned successfully.
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-279acccc-c5d1-4235-a9f8-14083daa0100 req-85cc896a-6496-4d71-8a67-7f944aa06a38 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-279acccc-c5d1-4235-a9f8-14083daa0100 req-85cc896a-6496-4d71-8a67-7f944aa06a38 service nova] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-279acccc-c5d1-4235-a9f8-14083daa0100 req-85cc896a-6496-4d71-8a67-7f944aa06a38 service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-279acccc-c5d1-4235-a9f8-14083daa0100 req-85cc896a-6496-4d71-8a67-7f944aa06a38 service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-279acccc-c5d1-4235-a9f8-14083daa0100 req-85cc896a-6496-4d71-8a67-7f944aa06a38 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] No waiting events found dispatching network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:46 user nova-compute[74441]: WARNING nova.compute.manager [req-279acccc-c5d1-4235-a9f8-14083daa0100 req-85cc896a-6496-4d71-8a67-7f944aa06a38 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received unexpected event network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 for instance with vm_state building and task_state spawning.
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:46:46 user nova-compute[74441]: INFO nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 09 00:46:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:46:46 user nova-compute[74441]: INFO nova.compute.manager [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Took 6.44 seconds to build instance.
Nov 09 00:46:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f53e6b77-dd04-4358-9dfc-6dc13671fbd2 tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.549s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating instance_info_cache with network_info: [{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:51 user nova-compute[74441]: INFO nova.compute.manager [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Rebooting instance
Nov 09 00:46:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:46:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-6335aa1d-9c03-435e-8341-a52a844e3c73 req-7cdac2c3-66b2-44de-acef-5fc34af7ae75 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-unplugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6335aa1d-9c03-435e-8341-a52a844e3c73 req-7cdac2c3-66b2-44de-acef-5fc34af7ae75 service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6335aa1d-9c03-435e-8341-a52a844e3c73 req-7cdac2c3-66b2-44de-acef-5fc34af7ae75 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6335aa1d-9c03-435e-8341-a52a844e3c73 req-7cdac2c3-66b2-44de-acef-5fc34af7ae75 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-6335aa1d-9c03-435e-8341-a52a844e3c73 req-7cdac2c3-66b2-44de-acef-5fc34af7ae75 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-unplugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:52 user nova-compute[74441]: WARNING nova.compute.manager [req-6335aa1d-9c03-435e-8341-a52a844e3c73 req-7cdac2c3-66b2-44de-acef-5fc34af7ae75 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-unplugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state active and task_state reboot_started_hard.
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance destroyed successfully.
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.objects.instance [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'resources' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1708721978',display_name='tempest-TestMinimumBasicScenario-server-1708721978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1708721978',id=11,image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1DyXAVVagm42WZaoBwEG/24CEZ37Beb75VSiZDVu4Mk7eTItv3/BxgMrQspHezCNa/h+6nPtj+ErqUcuudFif6KSCVSaVORhskuNjLFV9LdSt6SIQTeZTOWDYAdjZWcw==',key_name='tempest-TestMinimumBasicScenario-1543155359',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-g7kat2qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:46:52Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=b8916557-afd1-4f26-af6f-36d4bf1637d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG os_vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a83e73-e2, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=debd5bd3-a9ec-4bfb-a833-951233d08b20) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:52 user nova-compute[74441]: INFO os_vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2')
Nov 09 00:46:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:46:52 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:46:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:46:52 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eadd919-10e2-4a88-98af-4593c43745cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:46:53 user nova-compute[74441]: No targets found.
Nov 09 00:46:53 user nova-compute[74441]: iSNS:
Nov 09 00:46:53 user nova-compute[74441]: No targets found.
Nov 09 00:46:53 user nova-compute[74441]: STATIC:
Nov 09 00:46:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:46:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b
Nov 09 00:46:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf
Nov 09 00:46:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a
Nov 09 00:46:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:46:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:46:53 user nova-compute[74441]: FIRMWARE:
Nov 09 00:46:53 user nova-compute[74441]: No targets found.
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:46:53 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:46:53 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd30786-c107-4b2e-b722-cd3cecfb6ef1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2db2b4c-dddb-44b0-bece-54db0b90a65e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c2ca680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc'): ({'sdf'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Removing single pathed devices sdf {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beeaa96-5a4f-44c7-b923-0c4eb18bc033]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1ab35-ffea-4526-9bb3-194fe562e37a]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flushing IO for device /dev/sdf {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cade90-2fb7-4218-859e-dc3e626c6c1f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c630f678-11b1-4707-91f1-c6f241aba866]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc30d7-4e44-4aae-ba96-d3d5ff21c5fb]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812427e-a907-42a1-a6d4-d969d36a61dc]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]
Nov 09 00:46:53 user nova-compute[74441]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[529adf6a-626c-488e-90a3-5da13096ff33]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== disconnect_volume: return (444ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Start _get_guest_xml network_info=[{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c077062-0ceb-4a75-8d5b-5809f495e901,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '2c077062-0ceb-4a75-8d5b-5809f495e901'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'b8916557-afd1-4f26-af6f-36d4bf1637d5', 'attached_at': '', 'detached_at': '', 'volume_id': '84051cd9-ed96-413b-8135-fa3611cde4dc', 'serial': '84051cd9-ed96-413b-8135-fa3611cde4dc'}, 'attachment_id': '2c5580c5-dc88-4e05-bb4e-6309bca6f99f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:46:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2c077062-0ceb-4a75-8d5b-5809f495e901,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.objects.instance [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.objects.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Object Instance<b8916557-afd1-4f26-af6f-36d4bf1637d5> lazy-loaded attributes: resources,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:46:53 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:46:53 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:46:53 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eba7b7-f8be-4780-a064-b01c71d652f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:46:53 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[782cf9ce-40b9-407b-9949-3f394d6f433d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc] added
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf7ee3a-57b2-4e25-8280-0422ae009c6d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e1bb6f-cbc1-49db-8721-28b1e63a2ee7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syDJSNRf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v syDJSNRf" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f98f817-b668-4782-a782-2ae7d4f9c4d2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'syDJSNRf'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[37554de9-3374-4aea-89c0-b2d68d99dcbb]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6220afc-be94-4472-a381-8e8caa481c92]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd2ec2-0b0e-4424-85c9-8de2668921a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]
Nov 09 00:46:53 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9f983-9981-4c8c-8387-c921f371125b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ed4282-f35e-4412-bcf4-cb17795a9423]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:46:53 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:46:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.036s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad549cd-d437-4cd4-9ed4-aedaba5cecbc]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-ccaf6c05-7608-4068-a672-8f017b74b884 req-095951b1-e8d7-48e8-ab90-873ff5ebdb82 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ccaf6c05-7608-4068-a672-8f017b74b884 req-095951b1-e8d7-48e8-ab90-873ff5ebdb82 service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ccaf6c05-7608-4068-a672-8f017b74b884 req-095951b1-e8d7-48e8-ab90-873ff5ebdb82 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ccaf6c05-7608-4068-a672-8f017b74b884 req-095951b1-e8d7-48e8-ab90-873ff5ebdb82 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-ccaf6c05-7608-4068-a672-8f017b74b884 req-095951b1-e8d7-48e8-ab90-873ff5ebdb82 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:54 user nova-compute[74441]: WARNING nova.compute.manager [req-ccaf6c05-7608-4068-a672-8f017b74b884 req-095951b1-e8d7-48e8-ab90-873ff5ebdb82 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state active and task_state reboot_started_hard.
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23062333061363963', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:46:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062333061363963', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1708721978',display_name='tempest-TestMinimumBasicScenario-server-1708721978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1708721978',id=11,image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1DyXAVVagm42WZaoBwEG/24CEZ37Beb75VSiZDVu4Mk7eTItv3/BxgMrQspHezCNa/h+6nPtj+ErqUcuudFif6KSCVSaVORhskuNjLFV9LdSt6SIQTeZTOWDYAdjZWcw==',key_name='tempest-TestMinimumBasicScenario-1543155359',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-g7kat2qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:46:52Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=b8916557-afd1-4f26-af6f-36d4bf1637d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'pci_devices' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-changed-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing instance network info cache due to event network-changed-438936fd-f9fa-4b7a-b34d-52c4ca8da721. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] Acquiring lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] Acquired lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.neutron [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Refreshing network info cache for port 438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.objects.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Object Instance<b8916557-afd1-4f26-af6f-36d4bf1637d5> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:46:55 user nova-compute[74441]:   <uuid>b8916557-afd1-4f26-af6f-36d4bf1637d5</uuid>
Nov 09 00:46:55 user nova-compute[74441]:   <name>instance-0000000b</name>
Nov 09 00:46:55 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:46:55 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:46:55 user nova-compute[74441]:   <metadata>
Nov 09 00:46:55 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:46:55 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:46:55 user nova-compute[74441]:       <nova:name>tempest-TestMinimumBasicScenario-server-1708721978</nova:name>
Nov 09 00:46:55 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:46:53</nova:creationTime>
Nov 09 00:46:55 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:46:55 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:46:55 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:46:55 user nova-compute[74441]:       <nova:owner>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:user uuid="5d2d3eb3c7104c9b8f1fd56fd44b8933">tempest-TestMinimumBasicScenario-1304250277-project-member</nova:user>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:project uuid="e6403e99121d4daba82abd58c7ecb708">tempest-TestMinimumBasicScenario-1304250277</nova:project>
Nov 09 00:46:55 user nova-compute[74441]:       </nova:owner>
Nov 09 00:46:55 user nova-compute[74441]:       <nova:root type="image" uuid="2c077062-0ceb-4a75-8d5b-5809f495e901"/>
Nov 09 00:46:55 user nova-compute[74441]:       <nova:ports>
Nov 09 00:46:55 user nova-compute[74441]:         <nova:port uuid="f5a83e73-e216-4a35-98a4-325c2bfabf6f">
Nov 09 00:46:55 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:46:55 user nova-compute[74441]:         </nova:port>
Nov 09 00:46:55 user nova-compute[74441]:       </nova:ports>
Nov 09 00:46:55 user nova-compute[74441]:     </nova:instance>
Nov 09 00:46:55 user nova-compute[74441]:   </metadata>
Nov 09 00:46:55 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:46:55 user nova-compute[74441]:     <system>
Nov 09 00:46:55 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:46:55 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:46:55 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:46:55 user nova-compute[74441]:       <entry name="serial">b8916557-afd1-4f26-af6f-36d4bf1637d5</entry>
Nov 09 00:46:55 user nova-compute[74441]:       <entry name="uuid">b8916557-afd1-4f26-af6f-36d4bf1637d5</entry>
Nov 09 00:46:55 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:46:55 user nova-compute[74441]:     </system>
Nov 09 00:46:55 user nova-compute[74441]:   </sysinfo>
Nov 09 00:46:55 user nova-compute[74441]:   <os>
Nov 09 00:46:55 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:46:55 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:46:55 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:46:55 user nova-compute[74441]:   </os>
Nov 09 00:46:55 user nova-compute[74441]:   <features>
Nov 09 00:46:55 user nova-compute[74441]:     <acpi/>
Nov 09 00:46:55 user nova-compute[74441]:     <apic/>
Nov 09 00:46:55 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:46:55 user nova-compute[74441]:   </features>
Nov 09 00:46:55 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:46:55 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:46:55 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:46:55 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:46:55 user nova-compute[74441]:   </clock>
Nov 09 00:46:55 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:46:55 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:46:55 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:46:55 user nova-compute[74441]:   </cpu>
Nov 09 00:46:55 user nova-compute[74441]:   <devices>
Nov 09 00:46:55 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:46:55 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:46:55 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk"/>
Nov 09 00:46:55 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:46:55 user nova-compute[74441]:     </disk>
Nov 09 00:46:55 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:46:55 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:46:55 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 00:46:55 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:46:55 user nova-compute[74441]:       <serial>84051cd9-ed96-413b-8135-fa3611cde4dc</serial>
Nov 09 00:46:55 user nova-compute[74441]:     </disk>
Nov 09 00:46:55 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:46:55 user nova-compute[74441]:       <mac address="fa:16:3e:7d:49:fc"/>
Nov 09 00:46:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:55 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:46:55 user nova-compute[74441]:       <target dev="tapf5a83e73-e2"/>
Nov 09 00:46:55 user nova-compute[74441]:     </interface>
Nov 09 00:46:55 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:46:55 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/console.log" append="off"/>
Nov 09 00:46:55 user nova-compute[74441]:     </serial>
Nov 09 00:46:55 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:46:55 user nova-compute[74441]:     <video>
Nov 09 00:46:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:46:55 user nova-compute[74441]:     </video>
Nov 09 00:46:55 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:46:55 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:46:55 user nova-compute[74441]:     </rng>
Nov 09 00:46:55 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:46:55 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:46:55 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:46:55 user nova-compute[74441]:     </memballoon>
Nov 09 00:46:55 user nova-compute[74441]:   </devices>
Nov 09 00:46:55 user nova-compute[74441]: </domain>
Nov 09 00:46:55 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.objects.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Object Instance<b8916557-afd1-4f26-af6f-36d4bf1637d5> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.neutron [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updated VIF entry in instance network info cache for port 438936fd-f9fa-4b7a-b34d-52c4ca8da721. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.neutron [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [{"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-acc3930d-c4d7-44ed-b28f-6dda052481d5 req-75669af0-57f4-4ab2-b2e1-3a189a37325f service nova] Releasing lock "refresh_cache-772ff868-f9c9-4cbf-a100-c57b3f5de48b" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Cannot resize image /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'migration_context' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.objects.base [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Object Instance<b8916557-afd1-4f26-af6f-36d4bf1637d5> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1708721978',display_name='tempest-TestMinimumBasicScenario-server-1708721978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1708721978',id=11,image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1DyXAVVagm42WZaoBwEG/24CEZ37Beb75VSiZDVu4Mk7eTItv3/BxgMrQspHezCNa/h+6nPtj+ErqUcuudFif6KSCVSaVORhskuNjLFV9LdSt6SIQTeZTOWDYAdjZWcw==',key_name='tempest-TestMinimumBasicScenario-1543155359',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-g7kat2qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:52Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=b8916557-afd1-4f26-af6f-36d4bf1637d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG os_vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d70f022-079d-5948-b9d4-31ff4db0a63f', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a83e73-e2, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5a83e73-e2, col_values=(('qos', UUID('f6d4c32f-d908-48d3-950d-15817d0a2fb1')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5a83e73-e2, col_values=(('external_ids', {'iface-id': 'f5a83e73-e216-4a35-98a4-325c2bfabf6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:49:fc', 'vm-uuid': 'b8916557-afd1-4f26-af6f-36d4bf1637d5'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:46:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:55 user nova-compute[74441]: INFO os_vif [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2')
Nov 09 00:46:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:57 user nova-compute[74441]: INFO nova.compute.manager [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Terminating instance
Nov 09 00:46:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-1f8eb9cf-655e-4944-9b63-ea505f55380c req-a6d42b3b-f204-444a-8dca-643a05d396c8 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1f8eb9cf-655e-4944-9b63-ea505f55380c req-a6d42b3b-f204-444a-8dca-643a05d396c8 service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1f8eb9cf-655e-4944-9b63-ea505f55380c req-a6d42b3b-f204-444a-8dca-643a05d396c8 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1f8eb9cf-655e-4944-9b63-ea505f55380c req-a6d42b3b-f204-444a-8dca-643a05d396c8 service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-1f8eb9cf-655e-4944-9b63-ea505f55380c req-a6d42b3b-f204-444a-8dca-643a05d396c8 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:57 user nova-compute[74441]: WARNING nova.compute.manager [req-1f8eb9cf-655e-4944-9b63-ea505f55380c req-a6d42b3b-f204-444a-8dca-643a05d396c8 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state active and task_state reboot_started_hard.
Nov 09 00:46:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-397e10f3-d96a-4329-8815-3584cfbf41aa req-b51277da-481e-470f-a6dc-db1a6aef9e7d service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-397e10f3-d96a-4329-8815-3584cfbf41aa req-b51277da-481e-470f-a6dc-db1a6aef9e7d service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-397e10f3-d96a-4329-8815-3584cfbf41aa req-b51277da-481e-470f-a6dc-db1a6aef9e7d service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-397e10f3-d96a-4329-8815-3584cfbf41aa req-b51277da-481e-470f-a6dc-db1a6aef9e7d service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-397e10f3-d96a-4329-8815-3584cfbf41aa req-b51277da-481e-470f-a6dc-db1a6aef9e7d service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-397e10f3-d96a-4329-8815-3584cfbf41aa req-b51277da-481e-470f-a6dc-db1a6aef9e7d service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8d297c72-e589-4755-9cdf-7ee456203ee4 req-5c65c947-17c7-4d64-bde2-33c9fb376201 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8d297c72-e589-4755-9cdf-7ee456203ee4 req-5c65c947-17c7-4d64-bde2-33c9fb376201 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8d297c72-e589-4755-9cdf-7ee456203ee4 req-5c65c947-17c7-4d64-bde2-33c9fb376201 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8d297c72-e589-4755-9cdf-7ee456203ee4 req-5c65c947-17c7-4d64-bde2-33c9fb376201 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8d297c72-e589-4755-9cdf-7ee456203ee4 req-5c65c947-17c7-4d64-bde2-33c9fb376201 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-8d297c72-e589-4755-9cdf-7ee456203ee4 req-5c65c947-17c7-4d64-bde2-33c9fb376201 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:46:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:46:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:46:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state active and task_state reboot_started_hard.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-7a2f3f39-a5bb-4699-b744-dd695d1904cd for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-b0e68402-e24d-45e4-afac-b6e9a59ef02d for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-127accf4-df28-4e47-991c-09a2571517be for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-ec004fa1-519e-4009-9d1e-11466fdea6aa req-1dd9e2ca-663d-4c84-9a74-d4e3205439eb service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-127accf4-df28-4e47-991c-09a2571517be for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-438936fd-f9fa-4b7a-b34d-52c4ca8da721 for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-2f74a5a7-b670-45f8-947e-b5da91660635 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-2f74a5a7-b670-45f8-947e-b5da91660635 for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-unplugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-unplugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-e21c100b-786d-4d42-be8f-1db545d7f04e req-15a3e603-3390-46ff-9657-7ab0ce6a6e1c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-f86a628a-6821-4d8f-bc7b-059f0dac4c32 req-438ac45b-d0ca-483c-9052-c57314758d46 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f86a628a-6821-4d8f-bc7b-059f0dac4c32 req-438ac45b-d0ca-483c-9052-c57314758d46 service nova] Acquiring lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f86a628a-6821-4d8f-bc7b-059f0dac4c32 req-438ac45b-d0ca-483c-9052-c57314758d46 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f86a628a-6821-4d8f-bc7b-059f0dac4c32 req-438ac45b-d0ca-483c-9052-c57314758d46 service nova] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-f86a628a-6821-4d8f-bc7b-059f0dac4c32 req-438ac45b-d0ca-483c-9052-c57314758d46 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] No waiting events found dispatching network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.compute.manager [req-f86a628a-6821-4d8f-bc7b-059f0dac4c32 req-438ac45b-d0ca-483c-9052-c57314758d46 service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received unexpected event network-vif-plugged-4f896c9d-ea07-468f-9f6a-94c6702c3de6 for instance with vm_state active and task_state deleting.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Instance destroyed successfully.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lazy-loading 'resources' on Instance uuid 772ff868-f9c9-4cbf-a100-c57b3f5de48b {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:47:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance rebooted successfully.
Nov 09 00:47:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:47:00 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:47:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.225994110107422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "address": "fa:16:3e:3c:cc:e6", "network": {"id": "f1d692f2-afe6-4d4e-8dd3-757b6235468d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-912463744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap438936fd-f9", "ovs_interfaceid": "438936fd-f9fa-4b7a-b34d-52c4ca8da721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap438936fd-f9, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10fce713-5a9e-41f9-af30-3b16524672bf) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-da3775b7-371e-468e-842b-8b04f5d2bc1d tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.815s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:cc:e6,bridge_name='br-int',has_traffic_filtering=True,id=438936fd-f9fa-4b7a-b34d-52c4ca8da721,network=Network(f1d692f2-afe6-4d4e-8dd3-757b6235468d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap438936fd-f9')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a2f3f39-a5, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 772ff868-f9c9-4cbf-a100-c57b3f5de48b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a1f838d-1157-43c3-9e63-3fbd698d1916 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance be2c3dae-92a0-4b70-a253-c74c065afbef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48e18531-1f06-458e-9519-d518fc251735) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:13:ae,bridge_name='br-int',has_traffic_filtering=True,id=7a2f3f39-a5bb-4699-b744-dd695d1904cd,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7a2f3f39-a5')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0e68402-e2, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2e053b1-095a-43f0-a9a6-90291ab79e78) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cf:69,bridge_name='br-int',has_traffic_filtering=True,id=b0e68402-e24d-45e4-afac-b6e9a59ef02d,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0e68402-e2')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f896c9d-ea, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8c31fef-80a3-4786-ad9b-26294ad8ed69) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ee:e3,bridge_name='br-int',has_traffic_filtering=True,id=4f896c9d-ea07-468f-9f6a-94c6702c3de6,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f896c9d-ea')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap127accf4-df, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c27f0818-6093-4012-ad26-93461b435d22) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=127accf4-df28-4e47-991c-09a2571517be,network=Network(e1e0b3db-fc09-4e87-b0e0-647363a12eb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap127accf4-df')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f74a5a7-b6, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42366838-9848-499b-bb80-53a4da20f936) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:4e:af,bridge_name='br-int',has_traffic_filtering=True,id=2f74a5a7-b670-45f8-947e-b5da91660635,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f74a5a7-b6')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T00:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1267129226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1267129226',id=12,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7iK1uDB0XBWmS+IN6AO88GPqMgQvNMHzGc3EnxyqnpdGIW4f8wZ+6bMzelYnBoPLwo7SPbE3l7uni+eiOh/T5HvY9CIchbpVt9Dgeuu0HD4haPNok+joC7JZscmopyQQ==',key_name='tempest-keypair-647639840',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7674f3c6c6be458bab6baf5195da1f27',ramdisk_id='',reservation_id='r-k7x8440h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1062975088',owner_user_name='tempest-TaggedBootDevicesTest_v242-1062975088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5600a163b7af47d6b59480bd54e0f4e7',uuid=772ff868-f9c9-4cbf-a100-c57b3f5de48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converting VIF {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1abb294-bc, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c17ecb8f-28a7-45d7-820b-c23f2ef943a0) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:01 user nova-compute[74441]: INFO os_vif [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:77:7a,bridge_name='br-int',has_traffic_filtering=True,id=e1abb294-bcf6-4f45-a942-a35f4f19e6f7,network=Network(e30e699e-bc8f-4b50-8566-1fae3c7aa2d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1abb294-bc')
Nov 09 00:47:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMIGjAcQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:47:01 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d833f66-111f-499b-8d96-c0213d1d38b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:47:01 user nova-compute[74441]: No targets found.
Nov 09 00:47:01 user nova-compute[74441]: iSNS:
Nov 09 00:47:01 user nova-compute[74441]: No targets found.
Nov 09 00:47:01 user nova-compute[74441]: STATIC:
Nov 09 00:47:01 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:47:01 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:01 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:01 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b
Nov 09 00:47:01 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:01 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:01 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf
Nov 09 00:47:01 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:01 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:01 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a
Nov 09 00:47:01 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:01 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:01 user nova-compute[74441]: FIRMWARE:
Nov 09 00:47:01 user nova-compute[74441]: No targets found.
Nov 09 00:47:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:47:01 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:47:01 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[479cfb87-c357-4aed-9ce0-6f7137d0d809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52925f68-14d1-4a1e-8c95-c7b4d28004d4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:47:01 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:47:01 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:47:01 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b (non-flash)
Nov 09 00:47:01 user nova-compute[74441]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:47:01 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:47:01 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c647400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b01326-877b-452d-8ac4-313ef4895976]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63e04b6-1e4d-41b7-979f-75598e477758]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bca4c7-651b-46b0-b9cc-32d6401b8b0a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.080s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae79aa7-77d0-47f2-89e2-c73f7cb31954]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2b029-e11a-46c2-80bb-3532e59b531d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[06456d6d-dd60-488d-ad9c-87dcd9c1d373]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260]
Nov 09 00:47:02 user nova-compute[74441]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b, portal: 172.16.0.220,3260] successful.
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7180e750-8d04-442f-9e73-d07278f76b8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[685d1e13-af5d-4fa4-9860-3b50fa149a88]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== disconnect_volume: return (410ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLpFUhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:47:02 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a5c590-a99c-4876-9c43-1bb88debf5e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:47:02 user nova-compute[74441]: No targets found.
Nov 09 00:47:02 user nova-compute[74441]: iSNS:
Nov 09 00:47:02 user nova-compute[74441]: No targets found.
Nov 09 00:47:02 user nova-compute[74441]: STATIC:
Nov 09 00:47:02 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:47:02 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:02 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:02 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf
Nov 09 00:47:02 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:02 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:02 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a
Nov 09 00:47:02 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:02 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:02 user nova-compute[74441]: FIRMWARE:
Nov 09 00:47:02 user nova-compute[74441]: No targets found.
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:47:02 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:47:02 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f46bca-1ee4-47ae-8e2f-cd925b4f29ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d9f179-7772-433b-a72b-d6fcc882fd34]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:47:02 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:47:02 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a (non-flash)
Nov 09 00:47:02 user nova-compute[74441]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:47:02 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c647400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1fe793-6dfe-4404-aee6-5b5679a210a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5cba48-9270-4b93-b1e3-9a83e2d0ae91]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0433ddc5-b917-4da0-b761-3a394c53f5a6]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b489079a-5384-4b38-b06a-2c05ff2cadda]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95c2de-be78-4053-a120-e7f7645f0074]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[337b2732-0f58-44fe-99a3-941f83f4c690]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260]
Nov 09 00:47:02 user nova-compute[74441]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a, portal: 172.16.0.220,3260] successful.
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff0fbada-4331-4d52-8e14-2eac745a702a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[22babd3d-cb7f-4b54-8db0-694a47d8f07d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== disconnect_volume: return (340ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VaZhlrnI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:47:02 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5dd97a-c840-45a7-acbe-c20790beb099]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:47:02 user nova-compute[74441]: No targets found.
Nov 09 00:47:02 user nova-compute[74441]: iSNS:
Nov 09 00:47:02 user nova-compute[74441]: No targets found.
Nov 09 00:47:02 user nova-compute[74441]: STATIC:
Nov 09 00:47:02 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:47:02 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:02 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:02 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf
Nov 09 00:47:02 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:47:02 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:47:02 user nova-compute[74441]: FIRMWARE:
Nov 09 00:47:02 user nova-compute[74441]: No targets found.
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:47:02 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:47:02 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c74c2-4caf-4312-9800-4ff17b56a974]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b85f4-acb9-4848-8b70-25d3fb0540ed]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:47:02 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf (non-flash)
Nov 09 00:47:02 user nova-compute[74441]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c647400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf'): ({'sde'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Removing single pathed devices sde {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aca9ef-9ee7-4c82-8a06-0b90335be8dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ae0a5-10f8-48be-9de7-070e9f094a4f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Flushing IO for device /dev/sde {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[530464f3-4128-438e-b27d-3dedaec0ede0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[49845681-ce85-482e-b28d-aad9c904675d]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f874c12-e29a-46a4-b122-1fbe44e51c28]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b605c1e2-650c-4cc1-afb6-34911f6ed8ed]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260]
Nov 09 00:47:02 user nova-compute[74441]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf, portal: 172.16.0.220,3260] successful.
Nov 09 00:47:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d420062-7515-4f85-929e-46746d11cfcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9435e2-a2ab-467f-a5c2-727a239313a5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] <== disconnect_volume: return (302ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:47:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Deleting instance files /opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b_del
Nov 09 00:47:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Deletion of /opt/stack/data/nova/instances/772ff868-f9c9-4cbf-a100-c57b3f5de48b_del complete
Nov 09 00:47:02 user nova-compute[74441]: INFO nova.compute.manager [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Took 5.15 seconds to destroy the instance on the hypervisor.
Nov 09 00:47:02 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:47:02 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:47:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-dd55a56e-e633-4a8b-8dc1-1edf4d89c14e req-a0dad5c4-4bcf-4926-839e-e853650cd96c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-deleted-438936fd-f9fa-4b7a-b34d-52c4ca8da721 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:05 user nova-compute[74441]: INFO nova.compute.manager [req-dd55a56e-e633-4a8b-8dc1-1edf4d89c14e req-a0dad5c4-4bcf-4926-839e-e853650cd96c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Neutron deleted interface 438936fd-f9fa-4b7a-b34d-52c4ca8da721; detaching it from the instance and deleting it from the info cache
Nov 09 00:47:05 user nova-compute[74441]: DEBUG nova.network.neutron [req-dd55a56e-e633-4a8b-8dc1-1edf4d89c14e req-a0dad5c4-4bcf-4926-839e-e853650cd96c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [{"id": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "address": "fa:16:3e:10:13:ae", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f3f39-a5", "ovs_interfaceid": "7a2f3f39-a5bb-4699-b744-dd695d1904cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "address": "fa:16:3e:4b:cf:69", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0e68402-e2", "ovs_interfaceid": "b0e68402-e24d-45e4-afac-b6e9a59ef02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "address": "fa:16:3e:72:ee:e3", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f896c9d-ea", "ovs_interfaceid": "4f896c9d-ea07-468f-9f6a-94c6702c3de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "127accf4-df28-4e47-991c-09a2571517be", "address": "fa:16:3e:fd:53:e9", "network": {"id": "e1e0b3db-fc09-4e87-b0e0-647363a12eb7", "bridge": "br-int", "label": "tempest-device-tagging-net1-719144053", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127accf4-df", "ovs_interfaceid": "127accf4-df28-4e47-991c-09a2571517be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f74a5a7-b670-45f8-947e-b5da91660635", "address": "fa:16:3e:ab:4e:af", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f74a5a7-b6", "ovs_interfaceid": "2f74a5a7-b670-45f8-947e-b5da91660635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "address": "fa:16:3e:69:77:7a", "network": {"id": "e30e699e-bc8f-4b50-8566-1fae3c7aa2d6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1189728542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7674f3c6c6be458bab6baf5195da1f27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1abb294-bc", "ovs_interfaceid": "e1abb294-bcf6-4f45-a942-a35f4f19e6f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:47:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-dd55a56e-e633-4a8b-8dc1-1edf4d89c14e req-a0dad5c4-4bcf-4926-839e-e853650cd96c service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Detach interface failed, port_id=438936fd-f9fa-4b7a-b34d-52c4ca8da721, reason: Instance 772ff868-f9c9-4cbf-a100-c57b3f5de48b could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 00:47:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:06 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:47:06 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Took 4.04 seconds to deallocate network for instance.
Nov 09 00:47:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-f51373ac-9343-4b95-8048-303be6b88961 req-28a42b50-4b56-4324-bd22-83f6cce144ac service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-deleted-e1abb294-bcf6-4f45-a942-a35f4f19e6f7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-f51373ac-9343-4b95-8048-303be6b88961 req-28a42b50-4b56-4324-bd22-83f6cce144ac service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-deleted-2f74a5a7-b670-45f8-947e-b5da91660635 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-f51373ac-9343-4b95-8048-303be6b88961 req-28a42b50-4b56-4324-bd22-83f6cce144ac service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-deleted-4f896c9d-ea07-468f-9f6a-94c6702c3de6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-f51373ac-9343-4b95-8048-303be6b88961 req-28a42b50-4b56-4324-bd22-83f6cce144ac service nova] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Received event network-vif-deleted-127accf4-df28-4e47-991c-09a2571517be {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:09 user nova-compute[74441]: INFO nova.compute.manager [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] [instance: 772ff868-f9c9-4cbf-a100-c57b3f5de48b] Took 2.73 seconds to detach 3 volumes for instance.
Nov 09 00:47:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:09 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:47:09 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:47:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:10 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Deleted allocations for instance 772ff868-f9c9-4cbf-a100-c57b3f5de48b
Nov 09 00:47:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a88c8a27-5928-4eca-b9d7-a32a1db012e1 tempest-TaggedBootDevicesTest_v242-1062975088 tempest-TaggedBootDevicesTest_v242-1062975088-project-member] Lock "772ff868-f9c9-4cbf-a100-c57b3f5de48b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.469s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing instance network info cache due to event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:47:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:47:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:47:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:47:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updated VIF entry in instance network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:47:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:47:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-58e8fb7d-4cd4-49c0-bd99-398ffa0a29fe req-0c892a15-93bb-4381-b610-9f5787796a61 service nova] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:47:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:47:47 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHrQVATs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:47:47 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:47:47 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:47:47 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:47:47 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:47:47 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:47:47 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:47:47 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:47:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5cf25a-079e-4bff-9a81-544adc0af6f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:47:48 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15bbe82-008b-47cc-adf5-1e178cc58432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641] added
Nov 09 00:47:48 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd74a87c-6549-41b5-a0ff-68aabe473444]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1469f041-821b-4958-a928-78aaca7455c8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHrQVATs {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHrQVATs" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e4aea9-2efc-4f9f-bd7e-c99c3f0dcd82]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aHrQVATs'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c37983-64d9-458f-92e7-9c523f27209f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a53e93-d4ec-4051-b1e2-21af4c571691]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:48 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:48 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ae9f4f-b610-455c-bf45-cda38ccb842b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260]
Nov 09 00:47:48 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260] successful.
Nov 09 00:47:48 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d9213-68f8-450d-a23f-fb7c7e614399]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74663ef0-70e4-4101-8427-2bc066333acd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:48 user nova-compute[74441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 (non-flash)
Nov 09 00:47:48 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:47:48 user nova-compute[74441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 (non-flash)
Nov 09 00:47:48 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[94305d55-33f6-4a24-98c5-4c1addbe7ceb]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:47:48 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHrQVATs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23534643463353034', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534643463353034', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG nova.objects.instance [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'flavor' on Instance uuid cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:47:49 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:47:49 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:47:49 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:47:49 user nova-compute[74441]:   <serial>acb8a7f2-8533-4bcb-9ed3-839217fa5641</serial>
Nov 09 00:47:49 user nova-compute[74441]: </disk>
Nov 09 00:47:49 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No VIF found with MAC fa:16:3e:eb:a7:16, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:49 user nova-compute[74441]: INFO nova.compute.manager [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Shelving
Nov 09 00:47:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82a0656e-8362-45ca-b3a9-2f2d60a0b8db tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 75.265s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-b953df52-7f4d-4992-bb4c-40cce032414f req-ab500d3a-8289-4432-bc99-a60b0e2a7088 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-unplugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b953df52-7f4d-4992-bb4c-40cce032414f req-ab500d3a-8289-4432-bc99-a60b0e2a7088 service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b953df52-7f4d-4992-bb4c-40cce032414f req-ab500d3a-8289-4432-bc99-a60b0e2a7088 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b953df52-7f4d-4992-bb4c-40cce032414f req-ab500d3a-8289-4432-bc99-a60b0e2a7088 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-b953df52-7f4d-4992-bb4c-40cce032414f req-ab500d3a-8289-4432-bc99-a60b0e2a7088 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-unplugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:50 user nova-compute[74441]: WARNING nova.compute.manager [req-b953df52-7f4d-4992-bb4c-40cce032414f req-ab500d3a-8289-4432-bc99-a60b0e2a7088 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-unplugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state active and task_state shelving.
Nov 09 00:47:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance destroyed successfully.
Nov 09 00:47:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Beginning cold snapshot process
Nov 09 00:47:50 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:47:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk /opt/stack/data/nova/instances/snapshots/tmplvqc_v44/cb8345252eaf49fc935a796e88d4c801 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk /opt/stack/data/nova/instances/snapshots/tmplvqc_v44/cb8345252eaf49fc935a796e88d4c801" returned: 0 in 0.912s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Snapshot extracted, beginning image upload
Nov 09 00:47:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:51 user nova-compute[74441]: INFO nova.compute.manager [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Detaching volume acb8a7f2-8533-4bcb-9ed3-839217fa5641
Nov 09 00:47:52 user nova-compute[74441]: INFO nova.virt.block_device [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Attempting to driver detach volume acb8a7f2-8533-4bcb-9ed3-839217fa5641 from mountpoint /dev/vdb
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Attempting to detach device vdb from instance cc9f8946-b092-417e-80b8-0f96b1e7912a from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:47:52 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:47:52 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:47:52 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:47:52 user nova-compute[74441]:   <serial>acb8a7f2-8533-4bcb-9ed3-839217fa5641</serial>
Nov 09 00:47:52 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:47:52 user nova-compute[74441]: </disk>
Nov 09 00:47:52 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Successfully detached device vdb from instance cc9f8946-b092-417e-80b8-0f96b1e7912a from the persistent domain config.
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc9f8946-b092-417e-80b8-0f96b1e7912a from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:47:52 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:47:52 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:47:52 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:47:52 user nova-compute[74441]:   <serial>acb8a7f2-8533-4bcb-9ed3-839217fa5641</serial>
Nov 09 00:47:52 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:47:52 user nova-compute[74441]: </disk>
Nov 09 00:47:52 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-78fa8676-795f-4b4b-a46e-471767dca962 req-a487085a-4941-42fd-88fa-352a20a714d8 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-78fa8676-795f-4b4b-a46e-471767dca962 req-a487085a-4941-42fd-88fa-352a20a714d8 service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-78fa8676-795f-4b4b-a46e-471767dca962 req-a487085a-4941-42fd-88fa-352a20a714d8 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-78fa8676-795f-4b4b-a46e-471767dca962 req-a487085a-4941-42fd-88fa-352a20a714d8 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-78fa8676-795f-4b4b-a46e-471767dca962 req-a487085a-4941-42fd-88fa-352a20a714d8 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:47:52 user nova-compute[74441]: WARNING nova.compute.manager [req-78fa8676-795f-4b4b-a46e-471767dca962 req-a487085a-4941-42fd-88fa-352a20a714d8 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state active and task_state shelving_image_uploading.
Nov 09 00:47:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:47:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:47:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Snapshot image upload complete
Nov 09 00:47:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:47:54 user nova-compute[74441]: INFO nova.compute.manager [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Shelve offloading
Nov 09 00:47:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance destroyed successfully.
Nov 09 00:47:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:47:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:47:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:47:54 user nova-compute[74441]: DEBUG nova.network.neutron [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:56 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance destroyed successfully.
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.objects.instance [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'resources' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930618791',id=17,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMb25zfN3py8mmIpkXkL3rIxaATH7Epy6brvS8jLPf+74doXpIjBdQhF1yatgMPiUzJKmKnY+j+D6u5fH6q/+Kj3HziZBHsf85iUJmlqOQOCEiUJM9mj+NqMXycwse9Fw==',key_name='tempest-keypair-1628763909',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-90qwe0d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member',shelved_at='2023-11-09T00:47:54.765700',shelved_host='user',shelved_image_id='f35dcf7b-6224-4845-8e9b-5a7bb761f447'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=6a1f838d-1157-43c3-9e63-3fbd698d1916,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG os_vif [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a68cef1-a7, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c627c5c-a124-4aef-9f88-c5c685841dbe) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:56 user nova-compute[74441]: INFO os_vif [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7')
Nov 09 00:47:56 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Deleting instance files /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916_del
Nov 09 00:47:56 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Deletion of /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916_del complete
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing instance network info cache due to event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:56 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Deleted allocations for instance 6a1f838d-1157-43c3-9e63-3fbd698d1916
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.objects.instance [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.objects.base [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<6a1f838d-1157-43c3-9e63-3fbd698d1916> lazy-loaded attributes: resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:56 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Error from libvirt while getting description of instance-00000011: [Error Code 42] Domain not found: no domain with matching uuid '6a1f838d-1157-43c3-9e63-3fbd698d1916' (instance-00000011): libvirt.libvirtError: Domain not found: no domain with matching uuid '6a1f838d-1157-43c3-9e63-3fbd698d1916' (instance-00000011)
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updated VIF entry in instance network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-427abd5b-17bc-44af-853d-3bbafe0d73e8 req-5a605e62-e175-4571-a9d0-b14d730e8069 service nova] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:47:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-65259ed9-11e8-4a2a-9eaf-620a3fbfd981 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.072s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:47:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:47:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:47:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:47:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=25.13424301147461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance be2c3dae-92a0-4b70-a253-c74c065afbef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:47:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:01 user nova-compute[74441]: INFO nova.compute.manager [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Rescuing
Nov 09 00:48:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:48:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updating instance_info_cache with network_info: [{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-cd9d8351-f1f0-4514-ad26-ba71350bfead req-2751a732-d68c-43a2-b336-e1204b11d274 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-unplugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cd9d8351-f1f0-4514-ad26-ba71350bfead req-2751a732-d68c-43a2-b336-e1204b11d274 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cd9d8351-f1f0-4514-ad26-ba71350bfead req-2751a732-d68c-43a2-b336-e1204b11d274 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cd9d8351-f1f0-4514-ad26-ba71350bfead req-2751a732-d68c-43a2-b336-e1204b11d274 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-cd9d8351-f1f0-4514-ad26-ba71350bfead req-2751a732-d68c-43a2-b336-e1204b11d274 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-unplugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:02 user nova-compute[74441]: WARNING nova.compute.manager [req-cd9d8351-f1f0-4514-ad26-ba71350bfead req-2751a732-d68c-43a2-b336-e1204b11d274 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-unplugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state active and task_state rescuing.
Nov 09 00:48:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance destroyed successfully.
Nov 09 00:48:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Attempting rescue
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 00:48:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Creating image(s)
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue" returned: 0 in 0.061s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'migration_context' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.base [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<b5e4c1f2-f309-48b5-93aa-2bfdb8f31856> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Start _get_guest_xml network_info=[{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:fe:bf:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'resources' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.base [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<b5e4c1f2-f309-48b5-93aa-2bfdb8f31856> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'numa_topology' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.base [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<b5e4c1f2-f309-48b5-93aa-2bfdb8f31856> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:48:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:48:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.base [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<b5e4c1f2-f309-48b5-93aa-2bfdb8f31856> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656089628',display_name='tempest-ServerRescueNegativeTestJSON-server-1656089628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656089628',id=19,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-khe0d14u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:21Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=b5e4c1f2-f309-48b5-93aa-2bfdb8f31856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:fe:bf:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:fe:bf:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'pci_devices' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.objects.base [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<b5e4c1f2-f309-48b5-93aa-2bfdb8f31856> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:48:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:48:02 user nova-compute[74441]:   <uuid>b5e4c1f2-f309-48b5-93aa-2bfdb8f31856</uuid>
Nov 09 00:48:02 user nova-compute[74441]:   <name>instance-00000013</name>
Nov 09 00:48:02 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:48:02 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:48:02 user nova-compute[74441]:   <metadata>
Nov 09 00:48:02 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:48:02 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:48:02 user nova-compute[74441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1656089628</nova:name>
Nov 09 00:48:02 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:48:02</nova:creationTime>
Nov 09 00:48:02 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:48:02 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:48:02 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:48:02 user nova-compute[74441]:       <nova:owner>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:user uuid="383f477236d64d908d2a2868166d4107">tempest-ServerRescueNegativeTestJSON-1883004734-project-member</nova:user>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:project uuid="0b21e08a84834a8eb02dc374bb92b647">tempest-ServerRescueNegativeTestJSON-1883004734</nova:project>
Nov 09 00:48:02 user nova-compute[74441]:       </nova:owner>
Nov 09 00:48:02 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:48:02 user nova-compute[74441]:       <nova:ports>
Nov 09 00:48:02 user nova-compute[74441]:         <nova:port uuid="125829c5-3b93-4c47-8cf7-bb293cc53cd1">
Nov 09 00:48:02 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:48:02 user nova-compute[74441]:         </nova:port>
Nov 09 00:48:02 user nova-compute[74441]:       </nova:ports>
Nov 09 00:48:02 user nova-compute[74441]:     </nova:instance>
Nov 09 00:48:02 user nova-compute[74441]:   </metadata>
Nov 09 00:48:02 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:48:02 user nova-compute[74441]:     <system>
Nov 09 00:48:02 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:48:02 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:48:02 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:48:02 user nova-compute[74441]:       <entry name="serial">b5e4c1f2-f309-48b5-93aa-2bfdb8f31856</entry>
Nov 09 00:48:02 user nova-compute[74441]:       <entry name="uuid">b5e4c1f2-f309-48b5-93aa-2bfdb8f31856</entry>
Nov 09 00:48:02 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:48:02 user nova-compute[74441]:     </system>
Nov 09 00:48:02 user nova-compute[74441]:   </sysinfo>
Nov 09 00:48:02 user nova-compute[74441]:   <os>
Nov 09 00:48:02 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:48:02 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:48:02 user nova-compute[74441]:   </os>
Nov 09 00:48:02 user nova-compute[74441]:   <features>
Nov 09 00:48:02 user nova-compute[74441]:     <acpi/>
Nov 09 00:48:02 user nova-compute[74441]:     <apic/>
Nov 09 00:48:02 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:48:02 user nova-compute[74441]:   </features>
Nov 09 00:48:02 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:48:02 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:48:02 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:48:02 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:48:02 user nova-compute[74441]:   </clock>
Nov 09 00:48:02 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:48:02 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:48:02 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:48:02 user nova-compute[74441]:   </cpu>
Nov 09 00:48:02 user nova-compute[74441]:   <devices>
Nov 09 00:48:02 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:48:02 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:48:02 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue"/>
Nov 09 00:48:02 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:48:02 user nova-compute[74441]:     </disk>
Nov 09 00:48:02 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:48:02 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:48:02 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk"/>
Nov 09 00:48:02 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:48:02 user nova-compute[74441]:     </disk>
Nov 09 00:48:02 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:48:02 user nova-compute[74441]:       <mac address="fa:16:3e:fe:bf:c8"/>
Nov 09 00:48:02 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:48:02 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:48:02 user nova-compute[74441]:       <target dev="tap125829c5-3b"/>
Nov 09 00:48:02 user nova-compute[74441]:     </interface>
Nov 09 00:48:02 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:48:02 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/console.log" append="off"/>
Nov 09 00:48:02 user nova-compute[74441]:     </serial>
Nov 09 00:48:02 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:48:02 user nova-compute[74441]:     <video>
Nov 09 00:48:02 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:48:02 user nova-compute[74441]:     </video>
Nov 09 00:48:02 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:48:02 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:48:02 user nova-compute[74441]:     </rng>
Nov 09 00:48:02 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:48:02 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:48:02 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:48:02 user nova-compute[74441]:     </memballoon>
Nov 09 00:48:02 user nova-compute[74441]:   </devices>
Nov 09 00:48:02 user nova-compute[74441]: </domain>
Nov 09 00:48:02 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:48:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance destroyed successfully.
Nov 09 00:48:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:48:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:48:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:fe:bf:c8, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-df8457bd-196e-4f18-be02-d29500fde77d req-ebf2c165-9b62-48cc-983f-c118b3382061 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-df8457bd-196e-4f18-be02-d29500fde77d req-ebf2c165-9b62-48cc-983f-c118b3382061 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-df8457bd-196e-4f18-be02-d29500fde77d req-ebf2c165-9b62-48cc-983f-c118b3382061 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-df8457bd-196e-4f18-be02-d29500fde77d req-ebf2c165-9b62-48cc-983f-c118b3382061 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-df8457bd-196e-4f18-be02-d29500fde77d req-ebf2c165-9b62-48cc-983f-c118b3382061 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:04 user nova-compute[74441]: WARNING nova.compute.manager [req-df8457bd-196e-4f18-be02-d29500fde77d req-ebf2c165-9b62-48cc-983f-c118b3382061 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state active and task_state rescuing.
Nov 09 00:48:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:06 user nova-compute[74441]: WARNING nova.compute.manager [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state active and task_state rescuing.
Nov 09 00:48:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:06 user nova-compute[74441]: WARNING nova.compute.manager [req-643d4e7f-2309-465a-8ab5-12b405c713cd req-58b526a4-a1e5-4548-923a-ec0379d4abc6 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state active and task_state rescuing.
Nov 09 00:48:06 user nova-compute[74441]: DEBUG nova.compute.manager [None req-332d3028-e44b-4279-bfb7-907c6f233800 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:48:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Acquiring lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:10 user nova-compute[74441]: INFO nova.compute.manager [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Unshelving
Nov 09 00:48:10 user nova-compute[74441]: INFO nova.virt.block_device [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Booting with volume 9d1bdad4-636f-45d3-bde5-7276ef7ada6c at /dev/vda
Nov 09 00:48:10 user nova-compute[74441]: DEBUG os_brick.utils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95969a1e-599a-4ba6-9c8d-d2a8c3d3fef6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[665e6249-bb10-40c1-9dff-9d502b2b6621]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c2a7a6-a4ba-4d9b-b204-ffdb4e8412e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7b3df-43d9-47ae-91ca-99ce8f405b68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:48:10 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:48:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f111c05-7529-4b15-8424-9d19a43ac91c]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG os_brick.utils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:48:10 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Updating existing volume attachment record: bda5e43a-6419-4279-8f3a-9010dc508a65 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:48:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:12 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc9f8946-b092-417e-80b8-0f96b1e7912a is timed out.
Nov 09 00:48:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Successfully detached device vdb from instance cc9f8946-b092-417e-80b8-0f96b1e7912a from the live domain config.
Nov 09 00:48:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHrQVATs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:48:12 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b65c1-5794-4bd4-bc3d-c3a879f666df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:48:12 user nova-compute[74441]: No targets found.
Nov 09 00:48:12 user nova-compute[74441]: iSNS:
Nov 09 00:48:12 user nova-compute[74441]: No targets found.
Nov 09 00:48:12 user nova-compute[74441]: STATIC:
Nov 09 00:48:12 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641
Nov 09 00:48:12 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:48:12 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:48:12 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:48:12 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:48:12 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:48:12 user nova-compute[74441]: FIRMWARE:
Nov 09 00:48:12 user nova-compute[74441]: No targets found.
Nov 09 00:48:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:48:12 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:48:12 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c70d699-02a0-4f17-b6ae-4ed6dcd18f27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af2eba9-f3d9-4594-9850-489f8287463e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:48:12 user nova-compute[74441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 (non-flash)
Nov 09 00:48:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:48:12 user nova-compute[74441]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 (non-flash)
Nov 09 00:48:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c2c9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ec3e58-c2cf-4bdd-9f9f-b85b303c08f4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f27ffb-2d0a-47ed-a98b-6e7616d5cc6a]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf702ff-03ed-433f-a8fa-cdf70ff629da]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d028456c-1cff-43cd-9126-5e7ef6189fd2]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd6d54b-dfea-4ed1-9bf0-94f8c28eaa4f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[47499e46-afcf-4fcc-aeed-8f38784c858f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260]
Nov 09 00:48:12 user nova-compute[74441]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641, portal: 172.16.0.220,3260] successful.
Nov 09 00:48:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb8a7f2-8533-4bcb-9ed3-839217fa5641 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0563224-52b4-4393-851d-ce3cf68dc81a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] <== disconnect_volume: return (296ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:48:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:48:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-changed-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Refreshing instance network info cache due to event network-changed-22bdea8e-3969-48d2-bdc9-6e80f00a6542. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:48:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Refreshing network info cache for port 22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:48:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updated VIF entry in instance network info cache for port 22bdea8e-3969-48d2-bdc9-6e80f00a6542. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:48:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3ab8d60f-8552-491b-b14a-121f730c9d0b req-400fa6a2-0570-489f-bd75-065a4e38b7ed service nova] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:48:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:48:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:48:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:26 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'flavor' on Instance uuid cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e3b62c0f-baeb-4526-ab91-6441ace3843d tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.605s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.volume.cinder [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Update attachment failed for attachment bda5e43a-6419-4279-8f3a-9010dc508a65. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Traceback (most recent call last):
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     driver_block_device.attach_block_devices(
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     _log_and_attach(device)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     bdm.attach(*attach_args, **attach_kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     self._do_attach(context, instance, volume, volume_api,
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     self._volume_attach(context, volume, connector, instance,
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     connection_info = volume_api.attachment_update(
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     res = method(self, ctx, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     with excutils.save_and_reraise_exception():
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     self.force_reraise()
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     raise self.value
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     return method.func(obj, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     resp = self._update('/attachments/%s' % id, body)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     return self.request(url, method, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb]     raise exceptions.from_response(resp, body)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f)
Nov 09 00:48:27 user nova-compute[74441]: ERROR nova.compute.manager [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] 
Nov 09 00:48:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Lock "bf7c7bb1-037c-48a9-9673-b358578fa4eb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.589s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:27 user nova-compute[74441]: INFO nova.compute.manager [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] [instance: bf7c7bb1-037c-48a9-9673-b358578fa4eb] Successfully reverted task state from spawning on failure for instance.
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server [None req-95b5634a-7216-49e0-a3a8-f499905fc822 tempest-TestShelveInstance-1685523103 tempest-TestShelveInstance-1685523103-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7083, in unshelve_instance
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7080, in do_unshelve_instance
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7112, in _unshelve_instance
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a82cad29-8609-4daf-a642-47ecac77668f)
Nov 09 00:48:27 user nova-compute[74441]: ERROR oslo_messaging.rpc.server 
Nov 09 00:48:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:29 user nova-compute[74441]: INFO nova.compute.manager [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Terminating instance
Nov 09 00:48:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-98e33b75-4559-47a3-9026-544283475474 req-02e64116-c3c3-4371-9f6c-3d1ec11be1cc service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-vif-unplugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-98e33b75-4559-47a3-9026-544283475474 req-02e64116-c3c3-4371-9f6c-3d1ec11be1cc service nova] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-98e33b75-4559-47a3-9026-544283475474 req-02e64116-c3c3-4371-9f6c-3d1ec11be1cc service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-98e33b75-4559-47a3-9026-544283475474 req-02e64116-c3c3-4371-9f6c-3d1ec11be1cc service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-98e33b75-4559-47a3-9026-544283475474 req-02e64116-c3c3-4371-9f6c-3d1ec11be1cc service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] No waiting events found dispatching network-vif-unplugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-98e33b75-4559-47a3-9026-544283475474 req-02e64116-c3c3-4371-9f6c-3d1ec11be1cc service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-vif-unplugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Instance destroyed successfully.
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.objects.instance [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lazy-loading 'resources' on Instance uuid be2c3dae-92a0-4b70-a253-c74c065afbef {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-327477545',display_name='tempest-ServersNegativeTestJSON-server-327477545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-327477545',id=21,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1fcc87a3fe1470cbae7846b8020ff0e',ramdisk_id='',reservation_id='r-en1r959s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-296355111',owner_user_name='tempest-ServersNegativeTestJSON-296355111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:46:46Z,user_data=None,user_id='d8e5ce70bd2b4a01934c18f8e12d89f0',uuid=be2c3dae-92a0-4b70-a253-c74c065afbef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converting VIF {"id": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "address": "fa:16:3e:3a:2f:ab", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4536ad-d1", "ovs_interfaceid": "1d4536ad-d18e-4c5f-88b3-04dd33732f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG os_vif [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d4536ad-d1, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb94ad8e-5f8c-4186-8804-c6c0bc3c85ca) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:30 user nova-compute[74441]: INFO os_vif [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=1d4536ad-d18e-4c5f-88b3-04dd33732f97,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d4536ad-d1')
Nov 09 00:48:30 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Deleting instance files /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef_del
Nov 09 00:48:30 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Deletion of /opt/stack/data/nova/instances/be2c3dae-92a0-4b70-a253-c74c065afbef_del complete
Nov 09 00:48:30 user nova-compute[74441]: INFO nova.compute.manager [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 00:48:30 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:48:30 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:48:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:31 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:31 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Took 0.64 seconds to deallocate network for instance.
Nov 09 00:48:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-0e242d7c-5938-4ca1-8101-15d0bfd97254 req-53ab86b5-9b95-45a1-88b7-0d69f0e9fcde service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-vif-deleted-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:31 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:48:31 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:48:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:32 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Deleted allocations for instance be2c3dae-92a0-4b70-a253-c74c065afbef
Nov 09 00:48:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d8c8b2f6-98be-4ff6-b180-4c24c95ebddd tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-4e0c2fed-a62e-45fa-a29c-fdf2ea4723ba req-11f110e6-6a1d-4b25-871e-3f2244ca41f5 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received event network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4e0c2fed-a62e-45fa-a29c-fdf2ea4723ba req-11f110e6-6a1d-4b25-871e-3f2244ca41f5 service nova] Acquiring lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4e0c2fed-a62e-45fa-a29c-fdf2ea4723ba req-11f110e6-6a1d-4b25-871e-3f2244ca41f5 service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4e0c2fed-a62e-45fa-a29c-fdf2ea4723ba req-11f110e6-6a1d-4b25-871e-3f2244ca41f5 service nova] Lock "be2c3dae-92a0-4b70-a253-c74c065afbef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-4e0c2fed-a62e-45fa-a29c-fdf2ea4723ba req-11f110e6-6a1d-4b25-871e-3f2244ca41f5 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] No waiting events found dispatching network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:32 user nova-compute[74441]: WARNING nova.compute.manager [req-4e0c2fed-a62e-45fa-a29c-fdf2ea4723ba req-11f110e6-6a1d-4b25-871e-3f2244ca41f5 service nova] [instance: be2c3dae-92a0-4b70-a253-c74c065afbef] Received unexpected event network-vif-plugged-1d4536ad-d18e-4c5f-88b3-04dd33732f97 for instance with vm_state deleted and task_state None.
Nov 09 00:48:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:48:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:33 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:48:33 user nova-compute[74441]: INFO nova.compute.claims [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Claim successful on node user
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:48:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.policy [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dee4ca1b1a8d432d943ba7bf20f41f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c24e7fc6e24dd0bc5c8ca3bfd1166f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:48:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Creating image(s)
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk 1073741824" returned: 0 in 0.058s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Successfully created port: 3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Cannot resize image /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Ensure instance console log exists: /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Successfully updated port: 3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquired lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-changed-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Refreshing instance network info cache due to event network-changed-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] Acquiring lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updating instance_info_cache with network_info: [{"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Releasing lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance network_info: |[{"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] Acquired lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Refreshing network info cache for port 3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Start _get_guest_xml network_info=[{"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:48:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:48:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:48:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-957887165',display_name='tempest-tempest.common.compute-instance-957887165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-957887165',id=22,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3aiFj6myRk8LIGHu+y5KWZYh6GXAxxLvh2MQwbFHCRku5DTfO8A9kRI39wJav2cva+cH0ZsQWGClt63eKMxn4DJGhOyskYXv/gApv60ZizoZx3563A4DOFdnqBgIXM6A==',key_name='tempest-keypair-1946983635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-9jeth6pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=e376efb6-383e-489f-8c1f-13628b496528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.objects.instance [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'pci_devices' on Instance uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:48:36 user nova-compute[74441]:   <uuid>e376efb6-383e-489f-8c1f-13628b496528</uuid>
Nov 09 00:48:36 user nova-compute[74441]:   <name>instance-00000016</name>
Nov 09 00:48:36 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:48:36 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:48:36 user nova-compute[74441]:   <metadata>
Nov 09 00:48:36 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:48:36 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:48:36 user nova-compute[74441]:       <nova:name>tempest-tempest.common.compute-instance-957887165</nova:name>
Nov 09 00:48:36 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:48:35</nova:creationTime>
Nov 09 00:48:36 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:48:36 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:48:36 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:48:36 user nova-compute[74441]:       <nova:owner>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:user uuid="dee4ca1b1a8d432d943ba7bf20f41f1b">tempest-ServerActionsTestOtherA-1357980906-project-member</nova:user>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:project uuid="24c24e7fc6e24dd0bc5c8ca3bfd1166f">tempest-ServerActionsTestOtherA-1357980906</nova:project>
Nov 09 00:48:36 user nova-compute[74441]:       </nova:owner>
Nov 09 00:48:36 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:48:36 user nova-compute[74441]:       <nova:ports>
Nov 09 00:48:36 user nova-compute[74441]:         <nova:port uuid="3761d8f8-ca06-4ab0-8a0c-fe7561451cb9">
Nov 09 00:48:36 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 00:48:36 user nova-compute[74441]:         </nova:port>
Nov 09 00:48:36 user nova-compute[74441]:       </nova:ports>
Nov 09 00:48:36 user nova-compute[74441]:     </nova:instance>
Nov 09 00:48:36 user nova-compute[74441]:   </metadata>
Nov 09 00:48:36 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:48:36 user nova-compute[74441]:     <system>
Nov 09 00:48:36 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:48:36 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:48:36 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:48:36 user nova-compute[74441]:       <entry name="serial">e376efb6-383e-489f-8c1f-13628b496528</entry>
Nov 09 00:48:36 user nova-compute[74441]:       <entry name="uuid">e376efb6-383e-489f-8c1f-13628b496528</entry>
Nov 09 00:48:36 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:48:36 user nova-compute[74441]:     </system>
Nov 09 00:48:36 user nova-compute[74441]:   </sysinfo>
Nov 09 00:48:36 user nova-compute[74441]:   <os>
Nov 09 00:48:36 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:48:36 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:48:36 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:48:36 user nova-compute[74441]:   </os>
Nov 09 00:48:36 user nova-compute[74441]:   <features>
Nov 09 00:48:36 user nova-compute[74441]:     <acpi/>
Nov 09 00:48:36 user nova-compute[74441]:     <apic/>
Nov 09 00:48:36 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:48:36 user nova-compute[74441]:   </features>
Nov 09 00:48:36 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:48:36 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:48:36 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:48:36 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:48:36 user nova-compute[74441]:   </clock>
Nov 09 00:48:36 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:48:36 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:48:36 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:48:36 user nova-compute[74441]:   </cpu>
Nov 09 00:48:36 user nova-compute[74441]:   <devices>
Nov 09 00:48:36 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:48:36 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:48:36 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk"/>
Nov 09 00:48:36 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:48:36 user nova-compute[74441]:     </disk>
Nov 09 00:48:36 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:48:36 user nova-compute[74441]:       <mac address="fa:16:3e:33:3a:76"/>
Nov 09 00:48:36 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:48:36 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:48:36 user nova-compute[74441]:       <target dev="tap3761d8f8-ca"/>
Nov 09 00:48:36 user nova-compute[74441]:     </interface>
Nov 09 00:48:36 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:48:36 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/console.log" append="off"/>
Nov 09 00:48:36 user nova-compute[74441]:     </serial>
Nov 09 00:48:36 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:48:36 user nova-compute[74441]:     <video>
Nov 09 00:48:36 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:48:36 user nova-compute[74441]:     </video>
Nov 09 00:48:36 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:48:36 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:48:36 user nova-compute[74441]:     </rng>
Nov 09 00:48:36 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:48:36 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:48:36 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:48:36 user nova-compute[74441]:     </memballoon>
Nov 09 00:48:36 user nova-compute[74441]:   </devices>
Nov 09 00:48:36 user nova-compute[74441]: </domain>
Nov 09 00:48:36 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-957887165',display_name='tempest-tempest.common.compute-instance-957887165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-957887165',id=22,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3aiFj6myRk8LIGHu+y5KWZYh6GXAxxLvh2MQwbFHCRku5DTfO8A9kRI39wJav2cva+cH0ZsQWGClt63eKMxn4DJGhOyskYXv/gApv60ZizoZx3563A4DOFdnqBgIXM6A==',key_name='tempest-keypair-1946983635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-9jeth6pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=e376efb6-383e-489f-8c1f-13628b496528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG os_vif [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f192566-a46f-5dfa-b961-4d84da738af8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3761d8f8-ca, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3761d8f8-ca, col_values=(('qos', UUID('d361bf96-1490-457e-bae6-f853281ff5a2')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3761d8f8-ca, col_values=(('external_ids', {'iface-id': '3761d8f8-ca06-4ab0-8a0c-fe7561451cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:3a:76', 'vm-uuid': 'e376efb6-383e-489f-8c1f-13628b496528'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:36 user nova-compute[74441]: INFO os_vif [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca')
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No VIF found with MAC fa:16:3e:33:3a:76, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updated VIF entry in instance network info cache for port 3761d8f8-ca06-4ab0-8a0c-fe7561451cb9. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updating instance_info_cache with network_info: [{"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c0403d3-2608-49de-aa43-59f29e7acdac req-9a366e16-85de-4392-837b-2b1efe380a9a service nova] Releasing lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-c125fbea-573c-49eb-ac76-fff21879acae req-ceee2269-950b-4bfa-b482-75915511185e service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c125fbea-573c-49eb-ac76-fff21879acae req-ceee2269-950b-4bfa-b482-75915511185e service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c125fbea-573c-49eb-ac76-fff21879acae req-ceee2269-950b-4bfa-b482-75915511185e service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c125fbea-573c-49eb-ac76-fff21879acae req-ceee2269-950b-4bfa-b482-75915511185e service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-c125fbea-573c-49eb-ac76-fff21879acae req-ceee2269-950b-4bfa-b482-75915511185e service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:37 user nova-compute[74441]: WARNING nova.compute.manager [req-c125fbea-573c-49eb-ac76-fff21879acae req-ceee2269-950b-4bfa-b482-75915511185e service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state building and task_state spawning.
Nov 09 00:48:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-c4638a72-bc2d-4be3-9078-e337346e3f37 req-2093983b-9f4b-45fb-99d1-740be028a4c2 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c4638a72-bc2d-4be3-9078-e337346e3f37 req-2093983b-9f4b-45fb-99d1-740be028a4c2 service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c4638a72-bc2d-4be3-9078-e337346e3f37 req-2093983b-9f4b-45fb-99d1-740be028a4c2 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c4638a72-bc2d-4be3-9078-e337346e3f37 req-2093983b-9f4b-45fb-99d1-740be028a4c2 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-c4638a72-bc2d-4be3-9078-e337346e3f37 req-2093983b-9f4b-45fb-99d1-740be028a4c2 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:39 user nova-compute[74441]: WARNING nova.compute.manager [req-c4638a72-bc2d-4be3-9078-e337346e3f37 req-2093983b-9f4b-45fb-99d1-740be028a4c2 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state building and task_state spawning.
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:48:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance spawned successfully.
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:39 user nova-compute[74441]: INFO nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 09 00:48:39 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:48:39 user nova-compute[74441]: INFO nova.compute.manager [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Took 6.27 seconds to build instance.
Nov 09 00:48:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7e6f4e5a-29d2-4c90-b86a-f524f9f9a22c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.371s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:48:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:48:43 user nova-compute[74441]: INFO nova.compute.claims [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Claim successful on node user
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing instance network info cache due to event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.network.neutron [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:48:44 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.policy [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '197592c74bf14d389b65648dffd05aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09fe955c4cc64babb766d9c302cbcc9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:48:44 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Creating image(s)
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "/opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "/opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "/opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updated VIF entry in instance network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7f433f0-0d7e-439a-8a19-74de137b965f req-26069de8-f35b-4a27-b45d-0b99d6d98c7f service nova] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.269s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Successfully created port: 4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk 1073741824" returned: 0 in 0.068s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:45 user nova-compute[74441]: INFO nova.compute.manager [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Detaching volume 84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.230s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:45 user nova-compute[74441]: INFO nova.virt.block_device [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Attempting to driver detach volume 84051cd9-ed96-413b-8135-fa3611cde4dc from mountpoint /dev/vdb
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Attempting to detach device vdb from instance b8916557-afd1-4f26-af6f-36d4bf1637d5 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:48:45 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:48:45 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:48:45 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:48:45 user nova-compute[74441]:   <serial>84051cd9-ed96-413b-8135-fa3611cde4dc</serial>
Nov 09 00:48:45 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 00:48:45 user nova-compute[74441]: </disk>
Nov 09 00:48:45 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:48:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully detached device vdb from instance b8916557-afd1-4f26-af6f-36d4bf1637d5 from the persistent domain config.
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8916557-afd1-4f26-af6f-36d4bf1637d5 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:48:45 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:48:45 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:48:45 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:48:45 user nova-compute[74441]:   <serial>84051cd9-ed96-413b-8135-fa3611cde4dc</serial>
Nov 09 00:48:45 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 00:48:45 user nova-compute[74441]: </disk>
Nov 09 00:48:45 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Cannot resize image /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Ensure instance console log exists: /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Successfully updated port: 4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "refresh_cache-c68e841a-67a7-479a-b954-6d38a1d8edf8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquired lock "refresh_cache-c68e841a-67a7-479a-b954-6d38a1d8edf8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-changed-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Refreshing instance network info cache due to event network-changed-4c7216a6-260c-42b3-b37b-280428e19dc0. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:48:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] Acquiring lock "refresh_cache-c68e841a-67a7-479a-b954-6d38a1d8edf8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing instance network info cache due to event network-changed-f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] Acquiring lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] Acquired lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Refreshing network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Updating instance_info_cache with network_info: [{"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Releasing lock "refresh_cache-c68e841a-67a7-479a-b954-6d38a1d8edf8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Instance network_info: |[{"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] Acquired lock "refresh_cache-c68e841a-67a7-479a-b954-6d38a1d8edf8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Refreshing network info cache for port 4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Start _get_guest_xml network_info=[{"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:48:46 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:48:46 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1731392924',display_name='tempest-VolumesAdminNegativeTest-server-1731392924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1731392924',id=23,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09fe955c4cc64babb766d9c302cbcc9f',ramdisk_id='',reservation_id='r-pe0hmqr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-676102726',owner_user_name='tempest-VolumesAdminNegativeTest-676102726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:48:45Z,user_data=None,user_id='197592c74bf14d389b65648dffd05aa6',uuid=c68e841a-67a7-479a-b954-6d38a1d8edf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converting VIF {"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.objects.instance [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'pci_devices' on Instance uuid c68e841a-67a7-479a-b954-6d38a1d8edf8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:48:46 user nova-compute[74441]:   <uuid>c68e841a-67a7-479a-b954-6d38a1d8edf8</uuid>
Nov 09 00:48:46 user nova-compute[74441]:   <name>instance-00000017</name>
Nov 09 00:48:46 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:48:46 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:48:46 user nova-compute[74441]:   <metadata>
Nov 09 00:48:46 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:48:46 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:48:46 user nova-compute[74441]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1731392924</nova:name>
Nov 09 00:48:46 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:48:46</nova:creationTime>
Nov 09 00:48:46 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:48:46 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:48:46 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:48:46 user nova-compute[74441]:       <nova:owner>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:user uuid="197592c74bf14d389b65648dffd05aa6">tempest-VolumesAdminNegativeTest-676102726-project-member</nova:user>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:project uuid="09fe955c4cc64babb766d9c302cbcc9f">tempest-VolumesAdminNegativeTest-676102726</nova:project>
Nov 09 00:48:46 user nova-compute[74441]:       </nova:owner>
Nov 09 00:48:46 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:48:46 user nova-compute[74441]:       <nova:ports>
Nov 09 00:48:46 user nova-compute[74441]:         <nova:port uuid="4c7216a6-260c-42b3-b37b-280428e19dc0">
Nov 09 00:48:46 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 00:48:46 user nova-compute[74441]:         </nova:port>
Nov 09 00:48:46 user nova-compute[74441]:       </nova:ports>
Nov 09 00:48:46 user nova-compute[74441]:     </nova:instance>
Nov 09 00:48:46 user nova-compute[74441]:   </metadata>
Nov 09 00:48:46 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:48:46 user nova-compute[74441]:     <system>
Nov 09 00:48:46 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:48:46 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:48:46 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:48:46 user nova-compute[74441]:       <entry name="serial">c68e841a-67a7-479a-b954-6d38a1d8edf8</entry>
Nov 09 00:48:46 user nova-compute[74441]:       <entry name="uuid">c68e841a-67a7-479a-b954-6d38a1d8edf8</entry>
Nov 09 00:48:46 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:48:46 user nova-compute[74441]:     </system>
Nov 09 00:48:46 user nova-compute[74441]:   </sysinfo>
Nov 09 00:48:46 user nova-compute[74441]:   <os>
Nov 09 00:48:46 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:48:46 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:48:46 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:48:46 user nova-compute[74441]:   </os>
Nov 09 00:48:46 user nova-compute[74441]:   <features>
Nov 09 00:48:46 user nova-compute[74441]:     <acpi/>
Nov 09 00:48:46 user nova-compute[74441]:     <apic/>
Nov 09 00:48:46 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:48:46 user nova-compute[74441]:   </features>
Nov 09 00:48:46 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:48:46 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:48:46 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:48:46 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:48:46 user nova-compute[74441]:   </clock>
Nov 09 00:48:46 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:48:46 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:48:46 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:48:46 user nova-compute[74441]:   </cpu>
Nov 09 00:48:46 user nova-compute[74441]:   <devices>
Nov 09 00:48:46 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:48:46 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:48:46 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk"/>
Nov 09 00:48:46 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:48:46 user nova-compute[74441]:     </disk>
Nov 09 00:48:46 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:48:46 user nova-compute[74441]:       <mac address="fa:16:3e:31:be:49"/>
Nov 09 00:48:46 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:48:46 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:48:46 user nova-compute[74441]:       <target dev="tap4c7216a6-26"/>
Nov 09 00:48:46 user nova-compute[74441]:     </interface>
Nov 09 00:48:46 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:48:46 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/console.log" append="off"/>
Nov 09 00:48:46 user nova-compute[74441]:     </serial>
Nov 09 00:48:46 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:48:46 user nova-compute[74441]:     <video>
Nov 09 00:48:46 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:48:46 user nova-compute[74441]:     </video>
Nov 09 00:48:46 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:48:46 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:48:46 user nova-compute[74441]:     </rng>
Nov 09 00:48:46 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:48:46 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:48:46 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:48:46 user nova-compute[74441]:     </memballoon>
Nov 09 00:48:46 user nova-compute[74441]:   </devices>
Nov 09 00:48:46 user nova-compute[74441]: </domain>
Nov 09 00:48:46 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1731392924',display_name='tempest-VolumesAdminNegativeTest-server-1731392924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1731392924',id=23,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09fe955c4cc64babb766d9c302cbcc9f',ramdisk_id='',reservation_id='r-pe0hmqr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-676102726',owner_user_name='tempest-VolumesAdminNegativeTest-676102726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:48:45Z,user_data=None,user_id='197592c74bf14d389b65648dffd05aa6',uuid=c68e841a-67a7-479a-b954-6d38a1d8edf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converting VIF {"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG os_vif [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76b16865-27ab-57b2-a55f-0cefd110e351', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c7216a6-26, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c7216a6-26, col_values=(('qos', UUID('ca3976a7-9dce-4607-b6f2-b4cbdc3f0e28')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c7216a6-26, col_values=(('external_ids', {'iface-id': '4c7216a6-260c-42b3-b37b-280428e19dc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:be:49', 'vm-uuid': 'c68e841a-67a7-479a-b954-6d38a1d8edf8'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:46 user nova-compute[74441]: INFO os_vif [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26')
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] No VIF found with MAC fa:16:3e:31:be:49, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updated VIF entry in instance network info cache for port f5a83e73-e216-4a35-98a4-325c2bfabf6f. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [{"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6d406fa6-7603-4d95-8d9b-0b4c93aaa2fe req-e9b1b5a9-7b19-4c03-9aaf-7f0601206e43 service nova] Releasing lock "refresh_cache-b8916557-afd1-4f26-af6f-36d4bf1637d5" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Updated VIF entry in instance network info cache for port 4c7216a6-260c-42b3-b37b-280428e19dc0. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Updating instance_info_cache with network_info: [{"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dd91e2f9-6628-4773-a959-61ed390b7cd7 req-24186d9c-8ea7-4d38-a5cf-639199e92321 service nova] Releasing lock "refresh_cache-c68e841a-67a7-479a-b954-6d38a1d8edf8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 00:48:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-0adadd9c-38da-4825-83db-4d4db3914dfa req-d3ac2c64-321c-4c02-a0a7-ea28de687008 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0adadd9c-38da-4825-83db-4d4db3914dfa req-d3ac2c64-321c-4c02-a0a7-ea28de687008 service nova] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0adadd9c-38da-4825-83db-4d4db3914dfa req-d3ac2c64-321c-4c02-a0a7-ea28de687008 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0adadd9c-38da-4825-83db-4d4db3914dfa req-d3ac2c64-321c-4c02-a0a7-ea28de687008 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-0adadd9c-38da-4825-83db-4d4db3914dfa req-d3ac2c64-321c-4c02-a0a7-ea28de687008 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] No waiting events found dispatching network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:48 user nova-compute[74441]: WARNING nova.compute.manager [req-0adadd9c-38da-4825-83db-4d4db3914dfa req-d3ac2c64-321c-4c02-a0a7-ea28de687008 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received unexpected event network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 for instance with vm_state building and task_state spawning.
Nov 09 00:48:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:49 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 00:48:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-7522571a-cfc5-43ad-b5f4-ca14999f23d6 req-3ed1ce7f-2f6f-4b31-acde-1e4083dd0c56 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7522571a-cfc5-43ad-b5f4-ca14999f23d6 req-3ed1ce7f-2f6f-4b31-acde-1e4083dd0c56 service nova] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7522571a-cfc5-43ad-b5f4-ca14999f23d6 req-3ed1ce7f-2f6f-4b31-acde-1e4083dd0c56 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7522571a-cfc5-43ad-b5f4-ca14999f23d6 req-3ed1ce7f-2f6f-4b31-acde-1e4083dd0c56 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-7522571a-cfc5-43ad-b5f4-ca14999f23d6 req-3ed1ce7f-2f6f-4b31-acde-1e4083dd0c56 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] No waiting events found dispatching network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:48:50 user nova-compute[74441]: WARNING nova.compute.manager [req-7522571a-cfc5-43ad-b5f4-ca14999f23d6 req-3ed1ce7f-2f6f-4b31-acde-1e4083dd0c56 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received unexpected event network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 for instance with vm_state building and task_state spawning.
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:48:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Instance spawned successfully.
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:48:50 user nova-compute[74441]: INFO nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 09 00:48:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:48:50 user nova-compute[74441]: INFO nova.compute.manager [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Took 6.98 seconds to build instance.
Nov 09 00:48:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-80be3a67-b3b6-4e73-a818-fc930094283c tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.109s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:48:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:48:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:48:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:48:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:52 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating instance_info_cache with network_info: [{"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:48:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-cc9f8946-b092-417e-80b8-0f96b1e7912a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:48:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:48:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:48:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:49:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=25.1497802734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c68e841a-67a7-479a-b954-6d38a1d8edf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:49:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:49:02 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:49:02 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:49:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:49:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:06 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8916557-afd1-4f26-af6f-36d4bf1637d5 is timed out.
Nov 09 00:49:06 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully detached device vdb from instance b8916557-afd1-4f26-af6f-36d4bf1637d5 from the live domain config.
Nov 09 00:49:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'syDJSNRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:49:06 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92371e6-abc1-4b21-8f00-1310ad2e59a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:49:06 user nova-compute[74441]: No targets found.
Nov 09 00:49:06 user nova-compute[74441]: iSNS:
Nov 09 00:49:06 user nova-compute[74441]: No targets found.
Nov 09 00:49:06 user nova-compute[74441]: STATIC:
Nov 09 00:49:06 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc
Nov 09 00:49:06 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:49:06 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:49:06 user nova-compute[74441]: FIRMWARE:
Nov 09 00:49:06 user nova-compute[74441]: No targets found.
Nov 09 00:49:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:49:06 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:49:06 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea07c4-1761-488c-b9b6-9edc4049cfbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d6c38-0171-470c-a68f-08a30618b10c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:49:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc (non-flash)
Nov 09 00:49:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c6735b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d4815-34f0-4da3-ad29-3132e9b97736]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266382f-cbfa-4dd5-8c04-83eed499e334]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed141e43-330b-4b6e-b316-4cf6fcf767f2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9748e17d-774a-4497-9f8c-1e54329b9d6f]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b02a327-c249-4cd6-abd8-62e98d1d7346]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c20317c-f4dc-4c97-b1f7-fb2823d4873b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260]
Nov 09 00:49:06 user nova-compute[74441]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc, portal: 172.16.0.220,3260] successful.
Nov 09 00:49:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84051cd9-ed96-413b-8135-fa3611cde4dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[09430853-cd3d-4ad1-84c9-9daaffe91332]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== disconnect_volume: return (309ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:49:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:07 user nova-compute[74441]: DEBUG nova.objects.instance [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'flavor' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-be095804-9acd-4e0b-b5d8-0c51dc90642a tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:49:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:42 user nova-compute[74441]: INFO nova.compute.manager [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Unshelving
Nov 09 00:49:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:49:43 user nova-compute[74441]: INFO nova.compute.claims [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Claim successful on node user
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:49:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:43 user nova-compute[74441]: INFO nova.network.neutron [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating port 3a68cef1-a700-4e1d-9b90-cc4b6937a178 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing instance network info cache due to event network-changed-3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] Acquiring lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:49:44 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Creating image(s)
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] Acquired lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Refreshing network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG nova.objects.base [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<6a1f838d-1157-43c3-9e63-3fbd698d1916> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG nova.virt.images [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] f35dcf7b-6224-4845-8e9b-5a7bb761f447 was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.part /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG nova.network.neutron [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updated VIF entry in instance network info cache for port 3a68cef1-a700-4e1d-9b90-cc4b6937a178. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG nova.network.neutron [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:49:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9bb53d29-4098-46d8-bc22-b4e7856d42de req-d2b905ca-c792-4537-b5e7-1a576f443224 service nova] Releasing lock "refresh_cache-6a1f838d-1157-43c3-9e63-3fbd698d1916" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.part /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.converted" returned: 0 in 0.271s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.604s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b,backing_fmt=raw /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b,backing_fmt=raw /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk 1073741824" returned: 0 in 0.045s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'migration_context' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:46 user nova-compute[74441]: DEBUG nova.objects.base [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<6a1f838d-1157-43c3-9e63-3fbd698d1916> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:49:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Rebasing disk image.
Nov 09 00:49:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 -F raw /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 -F raw /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk" returned: 0 in 2.425s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Ensure instance console log exists: /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Start _get_guest_xml network_info=[{"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9eb9cae560fe25ec0f368afbbd605295',container_format='bare',created_at=2023-11-09T00:47:50Z,direct_url=<?>,disk_format='qcow2',id=f35dcf7b-6224-4845-8e9b-5a7bb761f447,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-930618791-shelved',owner='6f51b840472c4aeb8a0a5f2a5dfad975',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T00:47:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:49:49 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:49:49 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9eb9cae560fe25ec0f368afbbd605295',container_format='bare',created_at=2023-11-09T00:47:50Z,direct_url=<?>,disk_format='qcow2',id=f35dcf7b-6224-4845-8e9b-5a7bb761f447,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-930618791-shelved',owner='6f51b840472c4aeb8a0a5f2a5dfad975',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T00:47:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.objects.base [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<6a1f838d-1157-43c3-9e63-3fbd698d1916> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930618791',id=17,image_ref='f35dcf7b-6224-4845-8e9b-5a7bb761f447',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1628763909',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-90qwe0d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member',shelved_at='2023-11-09T00:47:54.765700',shelved_host='user',shelved_image_id='f35dcf7b-6224-4845-8e9b-5a7bb761f447'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=6a1f838d-1157-43c3-9e63-3fbd698d1916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.objects.base [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Object Instance<6a1f838d-1157-43c3-9e63-3fbd698d1916> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:49:49 user nova-compute[74441]:   <uuid>6a1f838d-1157-43c3-9e63-3fbd698d1916</uuid>
Nov 09 00:49:49 user nova-compute[74441]:   <name>instance-00000011</name>
Nov 09 00:49:49 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:49:49 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:49:49 user nova-compute[74441]:   <metadata>
Nov 09 00:49:49 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:49:49 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:49:49 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-930618791</nova:name>
Nov 09 00:49:49 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:49:49</nova:creationTime>
Nov 09 00:49:49 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:49:49 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:49:49 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:49:49 user nova-compute[74441]:       <nova:owner>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:user uuid="e8b687249f4d41d680915f2d30fc8dbd">tempest-AttachVolumeShelveTestJSON-1580389683-project-member</nova:user>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:project uuid="6f51b840472c4aeb8a0a5f2a5dfad975">tempest-AttachVolumeShelveTestJSON-1580389683</nova:project>
Nov 09 00:49:49 user nova-compute[74441]:       </nova:owner>
Nov 09 00:49:49 user nova-compute[74441]:       <nova:root type="image" uuid="f35dcf7b-6224-4845-8e9b-5a7bb761f447"/>
Nov 09 00:49:49 user nova-compute[74441]:       <nova:ports>
Nov 09 00:49:49 user nova-compute[74441]:         <nova:port uuid="3a68cef1-a700-4e1d-9b90-cc4b6937a178">
Nov 09 00:49:49 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 00:49:49 user nova-compute[74441]:         </nova:port>
Nov 09 00:49:49 user nova-compute[74441]:       </nova:ports>
Nov 09 00:49:49 user nova-compute[74441]:     </nova:instance>
Nov 09 00:49:49 user nova-compute[74441]:   </metadata>
Nov 09 00:49:49 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:49:49 user nova-compute[74441]:     <system>
Nov 09 00:49:49 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:49:49 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:49:49 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:49:49 user nova-compute[74441]:       <entry name="serial">6a1f838d-1157-43c3-9e63-3fbd698d1916</entry>
Nov 09 00:49:49 user nova-compute[74441]:       <entry name="uuid">6a1f838d-1157-43c3-9e63-3fbd698d1916</entry>
Nov 09 00:49:49 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:49:49 user nova-compute[74441]:     </system>
Nov 09 00:49:49 user nova-compute[74441]:   </sysinfo>
Nov 09 00:49:49 user nova-compute[74441]:   <os>
Nov 09 00:49:49 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:49:49 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:49:49 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:49:49 user nova-compute[74441]:   </os>
Nov 09 00:49:49 user nova-compute[74441]:   <features>
Nov 09 00:49:49 user nova-compute[74441]:     <acpi/>
Nov 09 00:49:49 user nova-compute[74441]:     <apic/>
Nov 09 00:49:49 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:49:49 user nova-compute[74441]:   </features>
Nov 09 00:49:49 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:49:49 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:49:49 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:49:49 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:49:49 user nova-compute[74441]:   </clock>
Nov 09 00:49:49 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:49:49 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:49:49 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:49:49 user nova-compute[74441]:   </cpu>
Nov 09 00:49:49 user nova-compute[74441]:   <devices>
Nov 09 00:49:49 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:49:49 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:49:49 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk"/>
Nov 09 00:49:49 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:49:49 user nova-compute[74441]:     </disk>
Nov 09 00:49:49 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:49:49 user nova-compute[74441]:       <mac address="fa:16:3e:5b:95:d3"/>
Nov 09 00:49:49 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:49:49 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:49:49 user nova-compute[74441]:       <target dev="tap3a68cef1-a7"/>
Nov 09 00:49:49 user nova-compute[74441]:     </interface>
Nov 09 00:49:49 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:49:49 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/console.log" append="off"/>
Nov 09 00:49:49 user nova-compute[74441]:     </serial>
Nov 09 00:49:49 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:49:49 user nova-compute[74441]:     <video>
Nov 09 00:49:49 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:49:49 user nova-compute[74441]:     </video>
Nov 09 00:49:49 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:49:49 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:49:49 user nova-compute[74441]:     </rng>
Nov 09 00:49:49 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:49:49 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:49:49 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:49:49 user nova-compute[74441]:     </memballoon>
Nov 09 00:49:49 user nova-compute[74441]:   </devices>
Nov 09 00:49:49 user nova-compute[74441]: </domain>
Nov 09 00:49:49 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930618791',id=17,image_ref='f35dcf7b-6224-4845-8e9b-5a7bb761f447',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1628763909',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:45:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-90qwe0d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member',shelved_at='2023-11-09T00:47:54.765700',shelved_host='user',shelved_image_id='f35dcf7b-6224-4845-8e9b-5a7bb761f447'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=6a1f838d-1157-43c3-9e63-3fbd698d1916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG os_vif [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9de4b30-c4e0-530e-a8f5-9b1b7acd1671', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a68cef1-a7, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a68cef1-a7, col_values=(('qos', UUID('7d2c9d1e-d375-4eb0-a574-08dd1bcf4c4d')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a68cef1-a7, col_values=(('external_ids', {'iface-id': '3a68cef1-a700-4e1d-9b90-cc4b6937a178', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:95:d3', 'vm-uuid': '6a1f838d-1157-43c3-9e63-3fbd698d1916'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:49 user nova-compute[74441]: INFO os_vif [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7')
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:49:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] No VIF found with MAC fa:16:3e:5b:95:d3, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-eeba3b6e-dcc8-40c8-bbd1-18857e43c0d3 req-516b37e1-c5c9-465d-9528-3da4589535ac service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-eeba3b6e-dcc8-40c8-bbd1-18857e43c0d3 req-516b37e1-c5c9-465d-9528-3da4589535ac service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-eeba3b6e-dcc8-40c8-bbd1-18857e43c0d3 req-516b37e1-c5c9-465d-9528-3da4589535ac service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-eeba3b6e-dcc8-40c8-bbd1-18857e43c0d3 req-516b37e1-c5c9-465d-9528-3da4589535ac service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-eeba3b6e-dcc8-40c8-bbd1-18857e43c0d3 req-516b37e1-c5c9-465d-9528-3da4589535ac service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:49:51 user nova-compute[74441]: WARNING nova.compute.manager [req-eeba3b6e-dcc8-40c8-bbd1-18857e43c0d3 req-516b37e1-c5c9-465d-9528-3da4589535ac service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 00:49:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Updating instance_info_cache with network_info: [{"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-378ca4d6-d23b-48f1-af42-c31978672971" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:49:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance spawned successfully.
Nov 09 00:49:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-f609f71a-9234-4d71-9583-9f6b0dfe8095 req-2a5bf597-0459-4488-b36f-9204149377c4 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f609f71a-9234-4d71-9583-9f6b0dfe8095 req-2a5bf597-0459-4488-b36f-9204149377c4 service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f609f71a-9234-4d71-9583-9f6b0dfe8095 req-2a5bf597-0459-4488-b36f-9204149377c4 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f609f71a-9234-4d71-9583-9f6b0dfe8095 req-2a5bf597-0459-4488-b36f-9204149377c4 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-f609f71a-9234-4d71-9583-9f6b0dfe8095 req-2a5bf597-0459-4488-b36f-9204149377c4 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:49:53 user nova-compute[74441]: WARNING nova.compute.manager [req-f609f71a-9234-4d71-9583-9f6b0dfe8095 req-2a5bf597-0459-4488-b36f-9204149377c4 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 00:49:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0e17e2ad-071a-48ac-8806-c4012b8d047f tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.186s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.320s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:49:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:50:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=25.092700958251953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b8916557-afd1-4f26-af6f-36d4bf1637d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c68e841a-67a7-479a-b954-6d38a1d8edf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a1f838d-1157-43c3-9e63-3fbd698d1916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:01 user nova-compute[74441]: INFO nova.compute.manager [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Terminating instance
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:50:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-9bc53c2b-8b67-4222-833b-94ed670d51b7 req-7a3ae1e4-8046-49c6-b6c9-6f02719c812e service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-unplugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9bc53c2b-8b67-4222-833b-94ed670d51b7 req-7a3ae1e4-8046-49c6-b6c9-6f02719c812e service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9bc53c2b-8b67-4222-833b-94ed670d51b7 req-7a3ae1e4-8046-49c6-b6c9-6f02719c812e service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9bc53c2b-8b67-4222-833b-94ed670d51b7 req-7a3ae1e4-8046-49c6-b6c9-6f02719c812e service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-9bc53c2b-8b67-4222-833b-94ed670d51b7 req-7a3ae1e4-8046-49c6-b6c9-6f02719c812e service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-unplugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-9bc53c2b-8b67-4222-833b-94ed670d51b7 req-7a3ae1e4-8046-49c6-b6c9-6f02719c812e service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-unplugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:50:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Instance destroyed successfully.
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'resources' on Instance uuid b8916557-afd1-4f26-af6f-36d4bf1637d5 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:43:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1708721978',display_name='tempest-TestMinimumBasicScenario-server-1708721978',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1708721978',id=11,image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1DyXAVVagm42WZaoBwEG/24CEZ37Beb75VSiZDVu4Mk7eTItv3/BxgMrQspHezCNa/h+6nPtj+ErqUcuudFif6KSCVSaVORhskuNjLFV9LdSt6SIQTeZTOWDYAdjZWcw==',key_name='tempest-TestMinimumBasicScenario-1543155359',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-g7kat2qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2c077062-0ceb-4a75-8d5b-5809f495e901',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:47:01Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=b8916557-afd1-4f26-af6f-36d4bf1637d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "address": "fa:16:3e:7d:49:fc", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a83e73-e2", "ovs_interfaceid": "f5a83e73-e216-4a35-98a4-325c2bfabf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG os_vif [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a83e73-e2, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6d4c32f-d908-48d3-950d-15817d0a2fb1) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:50:02 user nova-compute[74441]: INFO os_vif [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:49:fc,bridge_name='br-int',has_traffic_filtering=True,id=f5a83e73-e216-4a35-98a4-325c2bfabf6f,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a83e73-e2')
Nov 09 00:50:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Deleting instance files /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5_del
Nov 09 00:50:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Deletion of /opt/stack/data/nova/instances/b8916557-afd1-4f26-af6f-36d4bf1637d5_del complete
Nov 09 00:50:02 user nova-compute[74441]: INFO nova.compute.manager [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 09 00:50:02 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:50:02 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:50:03 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Took 0.51 seconds to deallocate network for instance.
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:03 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Deleted allocations for instance b8916557-afd1-4f26-af6f-36d4bf1637d5
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8f783a36-94ad-432b-bf25-f7b6239d8ce3 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] Acquiring lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] Lock "b8916557-afd1-4f26-af6f-36d4bf1637d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] No waiting events found dispatching network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:50:04 user nova-compute[74441]: WARNING nova.compute.manager [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received unexpected event network-vif-plugged-f5a83e73-e216-4a35-98a4-325c2bfabf6f for instance with vm_state deleted and task_state None.
Nov 09 00:50:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-e60f3cb1-7314-4e72-8685-8684c268ed26 req-2f8033e7-c1ee-4de0-82a3-5831faf0377a service nova] [instance: b8916557-afd1-4f26-af6f-36d4bf1637d5] Received event network-vif-deleted-f5a83e73-e216-4a35-98a4-325c2bfabf6f {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'flavor' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:50:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:16 user nova-compute[74441]: INFO nova.compute.manager [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Attaching volume c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 to /dev/vdb
Nov 09 00:50:16 user nova-compute[74441]: DEBUG os_brick.utils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac6a5df-0482-40db-8ebf-44fa50156214]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1f7b9d-575e-43ea-bd4a-bbf18bfff940]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0037de6-a8b0-4aa1-bbf0-37a311558366]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b18d56-5a09-4b6d-abb7-cad7043125bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:50:16 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:50:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0ef06-4f30-45de-963a-7ef64ed47e9d]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG os_brick.utils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:50:16 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating existing volume attachment record: d2137150-fa86-4c97-8d03-95ce82c4cffc {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:50:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-changed-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Refreshing instance network info cache due to event network-changed-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:50:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] Acquiring lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:50:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] Acquired lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:50:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Refreshing network info cache for port 3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updated VIF entry in instance network info cache for port 3761d8f8-ca06-4ab0-8a0c-fe7561451cb9. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updating instance_info_cache with network_info: [{"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f280f0b1-97b6-466b-b542-b3c4206d4e1a req-5fdc0890-30c2-4cde-bed1-8b04c1310ec6 service nova] Releasing lock "refresh_cache-e376efb6-383e-489f-8c1f-13628b496528" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'flavor' on Instance uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:25 user nova-compute[74441]: INFO nova.compute.manager [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attaching volume 60b6a51b-67c0-439b-a371-1dfaef66106b to /dev/vdb
Nov 09 00:50:25 user nova-compute[74441]: DEBUG os_brick.utils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3957a8-1ac4-4bcf-92dd-fd65ceeab568]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfed7287-cc6a-4aad-b2b1-bc76d09328d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc414a95-cdc5-46ea-91c1-99795fe3cf75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[38435275-1e60-4d14-bfe4-4f9c944699ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:50:25 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:50:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f543582f-285a-4909-9964-1fa7f949a0c7]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG os_brick.utils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:50:25 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updating existing volume attachment record: 656e5af7-89b3-40ab-a80f-58fdd9ce59ea {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:50:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:50:39 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:50:39 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:50:39 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8496e3-c1fe-4d1e-895a-56c31675e62a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:50:39 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[13749d62-e771-4230-8799-4e4a25dc1484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1] added
Nov 09 00:50:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1349b2-598d-4600-a7a9-bdafca4718d8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[14206596-7bda-45f6-8da8-bc0dcf66cb2d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENZMDPyg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENZMDPyg" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1656a7-fd80-43b7-8ec1-72e1c00e35b0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ENZMDPyg'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e6bdc-1922-447d-97fb-e6c8248a0d95]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa8c93-d709-413d-a99f-40f0c8376234]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:50:39 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:50:39 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:50:39 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 00:50:39 user nova-compute[74441]: 
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7670fc-a26e-4412-b01a-7d53003a7e65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]
Nov 09 00:50:39 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.
Nov 09 00:50:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3e0e42-c37c-416d-a53b-f31ea6f6ee13]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae910d27-f54a-4095-a615-47409168abbb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:50:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:50:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c85dda-85a7-4852-838a-118b16481561]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:50:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:50:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:50:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23831353130363561', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:50:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831353130363561', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:50:40 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'flavor' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:50:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:50:40 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:50:40 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:50:40 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:50:40 user nova-compute[74441]:   <serial>c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1</serial>
Nov 09 00:50:40 user nova-compute[74441]: </disk>
Nov 09 00:50:40 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:50:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:50:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:50:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No VIF found with MAC fa:16:3e:47:b1:f9, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:50:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c4c0a56f-b9bf-47fa-99fd-65d3a0cc2d1b tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.438s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Stashing vm_state: active {{(pid=74441) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 09 00:50:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:50:43 user nova-compute[74441]: INFO nova.compute.claims [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Claim successful on node user
Nov 09 00:50:43 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating resource usage from migration fc210883-195f-4199-bd9b-6ec6d4dac04c
Nov 09 00:50:44 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.479s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:44 user nova-compute[74441]: INFO nova.compute.manager [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Migrating
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:50:44 user nova-compute[74441]: INFO nova.compute.rpcapi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:50:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Starting migrate_disk_and_power_off {{(pid=74441) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-7b0df9eb-7b13-41ea-b4a4-c7abcbcce2be req-c3557e78-43a2-4d46-9af3-7fabc5ff0fbf service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b0df9eb-7b13-41ea-b4a4-c7abcbcce2be req-c3557e78-43a2-4d46-9af3-7fabc5ff0fbf service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b0df9eb-7b13-41ea-b4a4-c7abcbcce2be req-c3557e78-43a2-4d46-9af3-7fabc5ff0fbf service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b0df9eb-7b13-41ea-b4a4-c7abcbcce2be req-c3557e78-43a2-4d46-9af3-7fabc5ff0fbf service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-7b0df9eb-7b13-41ea-b4a4-c7abcbcce2be req-c3557e78-43a2-4d46-9af3-7fabc5ff0fbf service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:50:45 user nova-compute[74441]: WARNING nova.compute.manager [req-7b0df9eb-7b13-41ea-b4a4-c7abcbcce2be req-c3557e78-43a2-4d46-9af3-7fabc5ff0fbf service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state active and task_state resize_migrating.
Nov 09 00:50:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance destroyed successfully.
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22bdea8e-39, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73e7ef2b-b0ba-47bf-941b-4f3c1cbdd250) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:50:45 user nova-compute[74441]: INFO os_vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39')
Nov 09 00:50:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:50:45 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa24829e-491b-485f-992d-74fee0fa492f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:50:45 user nova-compute[74441]: No targets found.
Nov 09 00:50:45 user nova-compute[74441]: iSNS:
Nov 09 00:50:45 user nova-compute[74441]: No targets found.
Nov 09 00:50:45 user nova-compute[74441]: STATIC:
Nov 09 00:50:45 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1
Nov 09 00:50:45 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:50:45 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:50:45 user nova-compute[74441]: FIRMWARE:
Nov 09 00:50:45 user nova-compute[74441]: No targets found.
Nov 09 00:50:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:50:45 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:50:45 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf016b46-7e81-404d-824a-5541b5d90989]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c37d12-63f1-4c1a-9111-ad0d3bb99b15]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:50:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:50:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c6703a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:50:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f59c3d4-b910-4c46-a9e0-d674a2f544e7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3701fb-a476-4d30-8a05-c2f6f83e000d]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[027ded45-a380-464b-84ee-5a1814de7e8f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e1c43c-f137-4da5-9f1b-2424fd5a6b95]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e717ccd-2824-4c8a-bb09-9d40f879a562]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e59a9e-61b0-4d54-8c4f-5ed0156d941d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]
Nov 09 00:50:46 user nova-compute[74441]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.
Nov 09 00:50:46 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac1e1d-efad-4c00-ae1a-1c7cf099794b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== disconnect_volume: return (297ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8_resize/disk /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "cp -r /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8_resize/disk /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk" returned: 0 in 0.330s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8_resize/disk.info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk.info {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "cp -r /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8_resize/disk.info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk.info" returned: 0 in 0.034s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:47 user nova-compute[74441]: DEBUG nova.compute.manager [req-8a0ef3d9-58bc-4316-9b6e-3c5640e0d612 req-108c018a-2143-43b7-a780-0a7ca76b0c9b service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8a0ef3d9-58bc-4316-9b6e-3c5640e0d612 req-108c018a-2143-43b7-a780-0a7ca76b0c9b service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8a0ef3d9-58bc-4316-9b6e-3c5640e0d612 req-108c018a-2143-43b7-a780-0a7ca76b0c9b service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8a0ef3d9-58bc-4316-9b6e-3c5640e0d612 req-108c018a-2143-43b7-a780-0a7ca76b0c9b service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:47 user nova-compute[74441]: DEBUG nova.compute.manager [req-8a0ef3d9-58bc-4316-9b6e-3c5640e0d612 req-108c018a-2143-43b7-a780-0a7ca76b0c9b service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:50:47 user nova-compute[74441]: WARNING nova.compute.manager [req-8a0ef3d9-58bc-4316-9b6e-3c5640e0d612 req-108c018a-2143-43b7-a780-0a7ca76b0c9b service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state active and task_state resize_migrating.
Nov 09 00:50:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:50:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:50:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:50:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:56 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:50:56 user nova-compute[74441]: INFO nova.compute.claims [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Claim successful on node user
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.010s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:50:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.policy [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d2d3eb3c7104c9b8f1fd56fd44b8933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6403e99121d4daba82abd58c7ecb708', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:50:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Creating image(s)
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "/opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "/opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "bf8769eb1bfb3e6d46244e6a53af9dc93555d16e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "bf8769eb1bfb3e6d46244e6a53af9dc93555d16e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Successfully created port: 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.437s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.virt.images [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] b8b76416-c059-494a-99f6-b712873e902b was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.part /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.part /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.converted" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "bf8769eb1bfb3e6d46244e6a53af9dc93555d16e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.130s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Successfully updated port: 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing instance network info cache due to event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e --force-share --output=json" returned: 0 in 0.217s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "bf8769eb1bfb3e6d46244e6a53af9dc93555d16e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "bf8769eb1bfb3e6d46244e6a53af9dc93555d16e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e,backing_fmt=raw /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e,backing_fmt=raw /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk 1073741824" returned: 0 in 0.064s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "bf8769eb1bfb3e6d46244e6a53af9dc93555d16e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance network_info: |[{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.neutron [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e --force-share --output=json" returned: 0 in 0.234s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Cannot resize image /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Ensure instance console log exists: /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Start _get_guest_xml network_info=[{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:50:53Z,direct_url=<?>,disk_format='qcow2',id=b8b76416-c059-494a-99f6-b712873e902b,min_disk=0,min_ram=0,name='tempest-scenario-img--1840107686',owner='e6403e99121d4daba82abd58c7ecb708',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:50:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'b8b76416-c059-494a-99f6-b712873e902b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:50:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:50:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:50:53Z,direct_url=<?>,disk_format='qcow2',id=b8b76416-c059-494a-99f6-b712873e902b,min_disk=0,min_ram=0,name='tempest-scenario-img--1840107686',owner='e6403e99121d4daba82abd58c7ecb708',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:50:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-45659143',display_name='tempest-TestMinimumBasicScenario-server-45659143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-45659143',id=24,image_ref='b8b76416-c059-494a-99f6-b712873e902b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxSQ7OPtEJNNkSSmz83rQcwCl8pOILKD3mQapn5BmVKOE1k5svYW0sU/IvmegqzvE1mtzKpNGBhjxFpS8bZvOgBlbs35bKBSneB/RT9nIvb/UHuvWyNfpR0wH9mpHnoEw==',key_name='tempest-TestMinimumBasicScenario-701061094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-wpw1v71a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b8b76416-c059-494a-99f6-b712873e902b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:50:57Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=4e8a84ff-6f80-4580-bd05-8a57bc987c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:50:59 user nova-compute[74441]:   <uuid>4e8a84ff-6f80-4580-bd05-8a57bc987c48</uuid>
Nov 09 00:50:59 user nova-compute[74441]:   <name>instance-00000018</name>
Nov 09 00:50:59 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:50:59 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:50:59 user nova-compute[74441]:   <metadata>
Nov 09 00:50:59 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:50:59 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:50:59 user nova-compute[74441]:       <nova:name>tempest-TestMinimumBasicScenario-server-45659143</nova:name>
Nov 09 00:50:59 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:50:59</nova:creationTime>
Nov 09 00:50:59 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:50:59 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:50:59 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:50:59 user nova-compute[74441]:       <nova:owner>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:user uuid="5d2d3eb3c7104c9b8f1fd56fd44b8933">tempest-TestMinimumBasicScenario-1304250277-project-member</nova:user>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:project uuid="e6403e99121d4daba82abd58c7ecb708">tempest-TestMinimumBasicScenario-1304250277</nova:project>
Nov 09 00:50:59 user nova-compute[74441]:       </nova:owner>
Nov 09 00:50:59 user nova-compute[74441]:       <nova:root type="image" uuid="b8b76416-c059-494a-99f6-b712873e902b"/>
Nov 09 00:50:59 user nova-compute[74441]:       <nova:ports>
Nov 09 00:50:59 user nova-compute[74441]:         <nova:port uuid="5d82b02e-80cd-4d0e-b448-4283ac227b2e">
Nov 09 00:50:59 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 00:50:59 user nova-compute[74441]:         </nova:port>
Nov 09 00:50:59 user nova-compute[74441]:       </nova:ports>
Nov 09 00:50:59 user nova-compute[74441]:     </nova:instance>
Nov 09 00:50:59 user nova-compute[74441]:   </metadata>
Nov 09 00:50:59 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:50:59 user nova-compute[74441]:     <system>
Nov 09 00:50:59 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:50:59 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:50:59 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:50:59 user nova-compute[74441]:       <entry name="serial">4e8a84ff-6f80-4580-bd05-8a57bc987c48</entry>
Nov 09 00:50:59 user nova-compute[74441]:       <entry name="uuid">4e8a84ff-6f80-4580-bd05-8a57bc987c48</entry>
Nov 09 00:50:59 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:50:59 user nova-compute[74441]:     </system>
Nov 09 00:50:59 user nova-compute[74441]:   </sysinfo>
Nov 09 00:50:59 user nova-compute[74441]:   <os>
Nov 09 00:50:59 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:50:59 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:50:59 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:50:59 user nova-compute[74441]:   </os>
Nov 09 00:50:59 user nova-compute[74441]:   <features>
Nov 09 00:50:59 user nova-compute[74441]:     <acpi/>
Nov 09 00:50:59 user nova-compute[74441]:     <apic/>
Nov 09 00:50:59 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:50:59 user nova-compute[74441]:   </features>
Nov 09 00:50:59 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:50:59 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:50:59 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:50:59 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:50:59 user nova-compute[74441]:   </clock>
Nov 09 00:50:59 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:50:59 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:50:59 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:50:59 user nova-compute[74441]:   </cpu>
Nov 09 00:50:59 user nova-compute[74441]:   <devices>
Nov 09 00:50:59 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:50:59 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:50:59 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk"/>
Nov 09 00:50:59 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:50:59 user nova-compute[74441]:     </disk>
Nov 09 00:50:59 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:50:59 user nova-compute[74441]:       <mac address="fa:16:3e:a6:14:cd"/>
Nov 09 00:50:59 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:50:59 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:50:59 user nova-compute[74441]:       <target dev="tap5d82b02e-80"/>
Nov 09 00:50:59 user nova-compute[74441]:     </interface>
Nov 09 00:50:59 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:50:59 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/console.log" append="off"/>
Nov 09 00:50:59 user nova-compute[74441]:     </serial>
Nov 09 00:50:59 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:50:59 user nova-compute[74441]:     <video>
Nov 09 00:50:59 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:50:59 user nova-compute[74441]:     </video>
Nov 09 00:50:59 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:50:59 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:50:59 user nova-compute[74441]:     </rng>
Nov 09 00:50:59 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:50:59 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:50:59 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:50:59 user nova-compute[74441]:     </memballoon>
Nov 09 00:50:59 user nova-compute[74441]:   </devices>
Nov 09 00:50:59 user nova-compute[74441]: </domain>
Nov 09 00:50:59 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-45659143',display_name='tempest-TestMinimumBasicScenario-server-45659143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-45659143',id=24,image_ref='b8b76416-c059-494a-99f6-b712873e902b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxSQ7OPtEJNNkSSmz83rQcwCl8pOILKD3mQapn5BmVKOE1k5svYW0sU/IvmegqzvE1mtzKpNGBhjxFpS8bZvOgBlbs35bKBSneB/RT9nIvb/UHuvWyNfpR0wH9mpHnoEw==',key_name='tempest-TestMinimumBasicScenario-701061094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-wpw1v71a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b8b76416-c059-494a-99f6-b712873e902b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:50:57Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=4e8a84ff-6f80-4580-bd05-8a57bc987c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG os_vif [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28aa081b-7d60-5e02-a447-f54ab4f5e75a', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d82b02e-80, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d82b02e-80, col_values=(('qos', UUID('ed9cc596-ec3c-4cda-9f0a-cab9cbd1f5cb')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d82b02e-80, col_values=(('external_ids', {'iface-id': '5d82b02e-80cd-4d0e-b448-4283ac227b2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:14:cd', 'vm-uuid': '4e8a84ff-6f80-4580-bd05-8a57bc987c48'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:50:59 user nova-compute[74441]: INFO os_vif [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80')
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.neutron [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updated VIF entry in instance network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG nova.network.neutron [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:50:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a9e7258-d6d0-4adf-ac74-81514d33b741 req-314d8220-c7e7-4069-8ce9-ec467602f5e1 service nova] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No VIF found with MAC fa:16:3e:a6:14:cd, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-4bcf4a2b-a32c-4945-a615-0c3b7f4e9d8d req-8c40b41f-9780-4aaf-a84b-79f3a8740f51 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4bcf4a2b-a32c-4945-a615-0c3b7f4e9d8d req-8c40b41f-9780-4aaf-a84b-79f3a8740f51 service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4bcf4a2b-a32c-4945-a615-0c3b7f4e9d8d req-8c40b41f-9780-4aaf-a84b-79f3a8740f51 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4bcf4a2b-a32c-4945-a615-0c3b7f4e9d8d req-8c40b41f-9780-4aaf-a84b-79f3a8740f51 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-4bcf4a2b-a32c-4945-a615-0c3b7f4e9d8d req-8c40b41f-9780-4aaf-a84b-79f3a8740f51 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:01 user nova-compute[74441]: WARNING nova.compute.manager [req-4bcf4a2b-a32c-4945-a615-0c3b7f4e9d8d req-8c40b41f-9780-4aaf-a84b-79f3a8740f51 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state building and task_state spawning.
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-4701340f-b241-4450-980f-add5a8e751ca req-10279fed-553b-4cc4-af61-a0c07e79576d service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4701340f-b241-4450-980f-add5a8e751ca req-10279fed-553b-4cc4-af61-a0c07e79576d service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4701340f-b241-4450-980f-add5a8e751ca req-10279fed-553b-4cc4-af61-a0c07e79576d service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4701340f-b241-4450-980f-add5a8e751ca req-10279fed-553b-4cc4-af61-a0c07e79576d service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-4701340f-b241-4450-980f-add5a8e751ca req-10279fed-553b-4cc4-af61-a0c07e79576d service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:03 user nova-compute[74441]: WARNING nova.compute.manager [req-4701340f-b241-4450-980f-add5a8e751ca req-10279fed-553b-4cc4-af61-a0c07e79576d service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state building and task_state spawning.
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:51:03 user nova-compute[74441]: INFO nova.compute.manager [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Rescuing
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.network.neutron [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:51:03 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:51:03 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7839MB free_disk=25.10068130493164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:03 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance spawned successfully.
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:51:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Applying migration context for instance 670d138e-9fe7-40cc-810f-f88587f03bd8 as it has an incoming, in-progress migration fc210883-195f-4199-bd9b-6ec6d4dac04c. Migration status is migrating {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 00:51:04 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating resource usage from migration fc210883-195f-4199-bd9b-6ec6d4dac04c
Nov 09 00:51:04 user nova-compute[74441]: INFO nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c68e841a-67a7-479a-b954-6d38a1d8edf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a1f838d-1157-43c3-9e63-3fbd698d1916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Migration fc210883-195f-4199-bd9b-6ec6d4dac04c is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:51:04 user nova-compute[74441]: INFO nova.compute.manager [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Took 7.57 seconds to build instance.
Nov 09 00:51:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e771bd50-8682-48cf-9f23-e52ba9df677c tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.698s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.network.neutron [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance destroyed successfully.
Nov 09 00:51:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Attempting rescue
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 00:51:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Creating image(s)
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'trusted_certs' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue" returned: 0 in 0.052s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'migration_context' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.base [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<ef0e47ba-765a-456e-b9ea-6b7239c86820> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Start _get_guest_xml network_info=[{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:4c:42:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'resources' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.base [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<ef0e47ba-765a-456e-b9ea-6b7239c86820> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'numa_topology' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.base [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<ef0e47ba-765a-456e-b9ea-6b7239c86820> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:51:05 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:51:05 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.base [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<ef0e47ba-765a-456e-b9ea-6b7239c86820> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656914458',display_name='tempest-ServerRescueNegativeTestJSON-server-1656914458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656914458',id=18,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-zooi39sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:46:21Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=ef0e47ba-765a-456e-b9ea-6b7239c86820,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:4c:42:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:4c:42:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'pci_devices' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.objects.base [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<ef0e47ba-765a-456e-b9ea-6b7239c86820> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:51:05 user nova-compute[74441]:   <uuid>ef0e47ba-765a-456e-b9ea-6b7239c86820</uuid>
Nov 09 00:51:05 user nova-compute[74441]:   <name>instance-00000012</name>
Nov 09 00:51:05 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:51:05 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:51:05 user nova-compute[74441]:   <metadata>
Nov 09 00:51:05 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:51:05 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:51:05 user nova-compute[74441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1656914458</nova:name>
Nov 09 00:51:05 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:51:05</nova:creationTime>
Nov 09 00:51:05 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:51:05 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:51:05 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:51:05 user nova-compute[74441]:       <nova:owner>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:user uuid="383f477236d64d908d2a2868166d4107">tempest-ServerRescueNegativeTestJSON-1883004734-project-member</nova:user>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:project uuid="0b21e08a84834a8eb02dc374bb92b647">tempest-ServerRescueNegativeTestJSON-1883004734</nova:project>
Nov 09 00:51:05 user nova-compute[74441]:       </nova:owner>
Nov 09 00:51:05 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:51:05 user nova-compute[74441]:       <nova:ports>
Nov 09 00:51:05 user nova-compute[74441]:         <nova:port uuid="4b49fc37-2df4-4265-99be-94e5b5a8aa99">
Nov 09 00:51:05 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 00:51:05 user nova-compute[74441]:         </nova:port>
Nov 09 00:51:05 user nova-compute[74441]:       </nova:ports>
Nov 09 00:51:05 user nova-compute[74441]:     </nova:instance>
Nov 09 00:51:05 user nova-compute[74441]:   </metadata>
Nov 09 00:51:05 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:51:05 user nova-compute[74441]:     <system>
Nov 09 00:51:05 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:51:05 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:51:05 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:51:05 user nova-compute[74441]:       <entry name="serial">ef0e47ba-765a-456e-b9ea-6b7239c86820</entry>
Nov 09 00:51:05 user nova-compute[74441]:       <entry name="uuid">ef0e47ba-765a-456e-b9ea-6b7239c86820</entry>
Nov 09 00:51:05 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:51:05 user nova-compute[74441]:     </system>
Nov 09 00:51:05 user nova-compute[74441]:   </sysinfo>
Nov 09 00:51:05 user nova-compute[74441]:   <os>
Nov 09 00:51:05 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:51:05 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:51:05 user nova-compute[74441]:   </os>
Nov 09 00:51:05 user nova-compute[74441]:   <features>
Nov 09 00:51:05 user nova-compute[74441]:     <acpi/>
Nov 09 00:51:05 user nova-compute[74441]:     <apic/>
Nov 09 00:51:05 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:51:05 user nova-compute[74441]:   </features>
Nov 09 00:51:05 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:51:05 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:51:05 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:51:05 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:51:05 user nova-compute[74441]:   </clock>
Nov 09 00:51:05 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:51:05 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:51:05 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:51:05 user nova-compute[74441]:   </cpu>
Nov 09 00:51:05 user nova-compute[74441]:   <devices>
Nov 09 00:51:05 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:51:05 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:51:05 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue"/>
Nov 09 00:51:05 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:51:05 user nova-compute[74441]:     </disk>
Nov 09 00:51:05 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:51:05 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:51:05 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk"/>
Nov 09 00:51:05 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:51:05 user nova-compute[74441]:     </disk>
Nov 09 00:51:05 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:51:05 user nova-compute[74441]:       <mac address="fa:16:3e:4c:42:d5"/>
Nov 09 00:51:05 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:51:05 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:51:05 user nova-compute[74441]:       <target dev="tap4b49fc37-2d"/>
Nov 09 00:51:05 user nova-compute[74441]:     </interface>
Nov 09 00:51:05 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:51:05 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/console.log" append="off"/>
Nov 09 00:51:05 user nova-compute[74441]:     </serial>
Nov 09 00:51:05 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:51:05 user nova-compute[74441]:     <video>
Nov 09 00:51:05 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:51:05 user nova-compute[74441]:     </video>
Nov 09 00:51:05 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:51:05 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:51:05 user nova-compute[74441]:     </rng>
Nov 09 00:51:05 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:51:05 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:51:05 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:51:05 user nova-compute[74441]:     </memballoon>
Nov 09 00:51:05 user nova-compute[74441]:   </devices>
Nov 09 00:51:05 user nova-compute[74441]: </domain>
Nov 09 00:51:05 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:51:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance destroyed successfully.
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:05 user nova-compute[74441]: WARNING nova.compute.manager [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state active and task_state rescuing.
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:05 user nova-compute[74441]: WARNING nova.compute.manager [req-bc3444ba-b33a-40b1-bcde-24827a432a9e req-6dbab386-0174-4571-a2c0-73c07bf285ff service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state active and task_state rescuing.
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:51:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:4c:42:d5, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:51:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:07 user nova-compute[74441]: WARNING nova.compute.manager [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state active and task_state rescuing.
Nov 09 00:51:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:07 user nova-compute[74441]: WARNING nova.compute.manager [req-6be6270f-aff8-475e-a9c7-2dae8279fcb4 req-78b94a26-380b-45df-90f8-df3de241c882 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state active and task_state rescuing.
Nov 09 00:51:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-72aa2a87-b28a-4cda-b6bd-f43f78bca569 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:51:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:51:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:51:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:51:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:51:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:51:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Port 22bdea8e-3969-48d2-bdc9-6e80f00a6542 binding to destination host user is already ACTIVE {{(pid=74441) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:51:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG os_brick.utils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95590bd8-191c-4aaf-beca-ffbcc7359a3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[120c0315-cfdd-4361-8115-1ee1f787fb17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.053s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bc103-85d5-4ed4-8c7d-b83ddef0cee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a5d49-33ae-4d3f-af99-1a5306ccdf1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:51:27 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:51:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e2a6ff-fc4b-490d-bc6c-7966569c1e8b]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG os_brick.utils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:33 user nova-compute[74441]: INFO nova.compute.manager [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Terminating instance
Nov 09 00:51:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-71179c7d-d6d7-4c1b-a280-8f8a8af5f1e0 req-d7809098-a075-454e-933a-8ac8af3ffa68 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-unplugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71179c7d-d6d7-4c1b-a280-8f8a8af5f1e0 req-d7809098-a075-454e-933a-8ac8af3ffa68 service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71179c7d-d6d7-4c1b-a280-8f8a8af5f1e0 req-d7809098-a075-454e-933a-8ac8af3ffa68 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71179c7d-d6d7-4c1b-a280-8f8a8af5f1e0 req-d7809098-a075-454e-933a-8ac8af3ffa68 service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-71179c7d-d6d7-4c1b-a280-8f8a8af5f1e0 req-d7809098-a075-454e-933a-8ac8af3ffa68 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-unplugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-71179c7d-d6d7-4c1b-a280-8f8a8af5f1e0 req-d7809098-a075-454e-933a-8ac8af3ffa68 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-unplugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:51:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Instance destroyed successfully.
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lazy-loading 'resources' on Instance uuid 6a1f838d-1157-43c3-9e63-3fbd698d1916 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930618791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930618791',id=17,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMb25zfN3py8mmIpkXkL3rIxaATH7Epy6brvS8jLPf+74doXpIjBdQhF1yatgMPiUzJKmKnY+j+D6u5fH6q/+Kj3HziZBHsf85iUJmlqOQOCEiUJM9mj+NqMXycwse9Fw==',key_name='tempest-keypair-1628763909',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:49:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f51b840472c4aeb8a0a5f2a5dfad975',ramdisk_id='',reservation_id='r-90qwe0d8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1580389683',owner_user_name='tempest-AttachVolumeShelveTestJSON-1580389683-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:49:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8b687249f4d41d680915f2d30fc8dbd',uuid=6a1f838d-1157-43c3-9e63-3fbd698d1916,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converting VIF {"id": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "address": "fa:16:3e:5b:95:d3", "network": {"id": "3c420747-6aa1-408f-805b-1cbb03e59d7d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1190667223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f51b840472c4aeb8a0a5f2a5dfad975", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a68cef1-a7", "ovs_interfaceid": "3a68cef1-a700-4e1d-9b90-cc4b6937a178", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG os_vif [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a68cef1-a7, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d2c9d1e-d375-4eb0-a574-08dd1bcf4c4d) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:34 user nova-compute[74441]: INFO os_vif [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:95:d3,bridge_name='br-int',has_traffic_filtering=True,id=3a68cef1-a700-4e1d-9b90-cc4b6937a178,network=Network(3c420747-6aa1-408f-805b-1cbb03e59d7d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a68cef1-a7')
Nov 09 00:51:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Deleting instance files /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916_del
Nov 09 00:51:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Deletion of /opt/stack/data/nova/instances/6a1f838d-1157-43c3-9e63-3fbd698d1916_del complete
Nov 09 00:51:34 user nova-compute[74441]: INFO nova.compute.manager [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 09 00:51:34 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:51:34 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Took 0.76 seconds to deallocate network for instance.
Nov 09 00:51:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-54cf6241-0a45-408b-9fcd-8b9fb3316e2e req-9f7dbb5d-caf8-4ceb-8773-09194f5f6785 service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-deleted-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:35 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Deleted allocations for instance 6a1f838d-1157-43c3-9e63-3fbd698d1916
Nov 09 00:51:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-39db444c-d0ef-4099-b691-6e5274e6db26 tempest-AttachVolumeShelveTestJSON-1580389683 tempest-AttachVolumeShelveTestJSON-1580389683-project-member] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8d2e18a-fee2-488b-8f42-e93f0d130d5b req-4afaceb1-320a-4983-b1b7-e0e7d508f35f service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8d2e18a-fee2-488b-8f42-e93f0d130d5b req-4afaceb1-320a-4983-b1b7-e0e7d508f35f service nova] Acquiring lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8d2e18a-fee2-488b-8f42-e93f0d130d5b req-4afaceb1-320a-4983-b1b7-e0e7d508f35f service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8d2e18a-fee2-488b-8f42-e93f0d130d5b req-4afaceb1-320a-4983-b1b7-e0e7d508f35f service nova] Lock "6a1f838d-1157-43c3-9e63-3fbd698d1916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8d2e18a-fee2-488b-8f42-e93f0d130d5b req-4afaceb1-320a-4983-b1b7-e0e7d508f35f service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] No waiting events found dispatching network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:35 user nova-compute[74441]: WARNING nova.compute.manager [req-a8d2e18a-fee2-488b-8f42-e93f0d130d5b req-4afaceb1-320a-4983-b1b7-e0e7d508f35f service nova] [instance: 6a1f838d-1157-43c3-9e63-3fbd698d1916] Received unexpected event network-vif-plugged-3a68cef1-a700-4e1d-9b90-cc4b6937a178 for instance with vm_state deleted and task_state None.
Nov 09 00:51:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:51:37 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:51:37 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:51:37 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70cb830-36ec-4712-8177-3b23ac26e23b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:51:37 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a1187-c119-4658-a87f-8a1759ac4154]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b] added
Nov 09 00:51:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e2e10-13f4-4464-85e8-02f825af9f47]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af6d60e-ee8c-41a4-90d1-6c61a0e6182c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAefFJQu {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAefFJQu" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11283a76-2bc8-4eb8-a7a3-088bce98d9e4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAefFJQu'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098ea61-587e-4af5-a372-08cbb5fde0d1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4623fad6-673c-45a0-b43b-851eb08f4535]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:51:37 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:51:37 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:51:37 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 00:51:37 user nova-compute[74441]: 
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[20821c06-9a76-4325-863d-9323ebd84ea5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]
Nov 09 00:51:37 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.
Nov 09 00:51:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a376e7fb-54a3-415b-9353-2add1b2b5936]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09d4ae-efca-417b-b134-0e8b72c7ead9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:51:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:51:37 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0102d7a-cf2c-473b-ab2e-ac119af5f055]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:51:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:38 user nova-compute[74441]: INFO nova.compute.manager [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Terminating instance
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23839353036356433', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839353036356433', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'flavor' on Instance uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-664211db-4952-4baa-8f67-36a6729805d8 req-bbf1bba7-0017-4417-a763-dcb2c6e43e02 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-vif-unplugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-664211db-4952-4baa-8f67-36a6729805d8 req-bbf1bba7-0017-4417-a763-dcb2c6e43e02 service nova] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-664211db-4952-4baa-8f67-36a6729805d8 req-bbf1bba7-0017-4417-a763-dcb2c6e43e02 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-664211db-4952-4baa-8f67-36a6729805d8 req-bbf1bba7-0017-4417-a763-dcb2c6e43e02 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-664211db-4952-4baa-8f67-36a6729805d8 req-bbf1bba7-0017-4417-a763-dcb2c6e43e02 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] No waiting events found dispatching network-vif-unplugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-664211db-4952-4baa-8f67-36a6729805d8 req-bbf1bba7-0017-4417-a763-dcb2c6e43e02 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-vif-unplugged-4c7216a6-260c-42b3-b37b-280428e19dc0 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:51:38 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:51:38 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:51:38 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:51:38 user nova-compute[74441]:   <serial>60b6a51b-67c0-439b-a371-1dfaef66106b</serial>
Nov 09 00:51:38 user nova-compute[74441]: </disk>
Nov 09 00:51:38 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Instance destroyed successfully.
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'resources' on Instance uuid c68e841a-67a7-479a-b954-6d38a1d8edf8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1731392924',display_name='tempest-VolumesAdminNegativeTest-server-1731392924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1731392924',id=23,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:48:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09fe955c4cc64babb766d9c302cbcc9f',ramdisk_id='',reservation_id='r-pe0hmqr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-676102726',owner_user_name='tempest-VolumesAdminNegativeTest-676102726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:48:51Z,user_data=None,user_id='197592c74bf14d389b65648dffd05aa6',uuid=c68e841a-67a7-479a-b954-6d38a1d8edf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converting VIF {"id": "4c7216a6-260c-42b3-b37b-280428e19dc0", "address": "fa:16:3e:31:be:49", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c7216a6-26", "ovs_interfaceid": "4c7216a6-260c-42b3-b37b-280428e19dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG os_vif [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c7216a6-26, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca3976a7-9dce-4607-b6f2-b4cbdc3f0e28) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:39 user nova-compute[74441]: INFO os_vif [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:49,bridge_name='br-int',has_traffic_filtering=True,id=4c7216a6-260c-42b3-b37b-280428e19dc0,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c7216a6-26')
Nov 09 00:51:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Deleting instance files /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8_del
Nov 09 00:51:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Deletion of /opt/stack/data/nova/instances/c68e841a-67a7-479a-b954-6d38a1d8edf8_del complete
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No VIF found with MAC fa:16:3e:33:3a:76, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:51:39 user nova-compute[74441]: INFO nova.compute.manager [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 09 00:51:39 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a320a990-4cff-4e6b-ae4f-35cc1e733665 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 74.180s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:39 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:51:39 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Took 0.49 seconds to deallocate network for instance.
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:40 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Deleted allocations for instance c68e841a-67a7-479a-b954-6d38a1d8edf8
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5f856046-f4d8-40dd-9c67-eafb8777247f tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:40 user nova-compute[74441]: INFO nova.compute.manager [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Rebuilding instance
Nov 09 00:51:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] Acquiring lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] Lock "c68e841a-67a7-479a-b954-6d38a1d8edf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] No waiting events found dispatching network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:40 user nova-compute[74441]: WARNING nova.compute.manager [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received unexpected event network-vif-plugged-4c7216a6-260c-42b3-b37b-280428e19dc0 for instance with vm_state deleted and task_state None.
Nov 09 00:51:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-2d7bd38e-f82c-4a64-a765-8ec1a42af117 req-b73190a6-8aa2-4017-9ada-07badaf2ddc5 service nova] [instance: c68e841a-67a7-479a-b954-6d38a1d8edf8] Received event network-vif-deleted-4c7216a6-260c-42b3-b37b-280428e19dc0 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance destroyed successfully.
Nov 09 00:51:41 user nova-compute[74441]: INFO nova.compute.manager [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Detaching volume 60b6a51b-67c0-439b-a371-1dfaef66106b
Nov 09 00:51:42 user nova-compute[74441]: INFO nova.virt.block_device [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attempting to driver detach volume 60b6a51b-67c0-439b-a371-1dfaef66106b from mountpoint /dev/vdb
Nov 09 00:51:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Attempting to detach device vdb from instance e376efb6-383e-489f-8c1f-13628b496528 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:51:42 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:51:42 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:51:42 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:51:42 user nova-compute[74441]:   <serial>60b6a51b-67c0-439b-a371-1dfaef66106b</serial>
Nov 09 00:51:42 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:51:42 user nova-compute[74441]: </disk>
Nov 09 00:51:42 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:51:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully detached device vdb from instance e376efb6-383e-489f-8c1f-13628b496528 from the persistent domain config.
Nov 09 00:51:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:51:42 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9015318b-1044-407b-93e0-5357a38e7504]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:51:42 user nova-compute[74441]: No targets found.
Nov 09 00:51:42 user nova-compute[74441]: iSNS:
Nov 09 00:51:42 user nova-compute[74441]: No targets found.
Nov 09 00:51:42 user nova-compute[74441]: STATIC:
Nov 09 00:51:42 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b
Nov 09 00:51:42 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:51:42 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:51:42 user nova-compute[74441]: FIRMWARE:
Nov 09 00:51:42 user nova-compute[74441]: No targets found.
Nov 09 00:51:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:51:42 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:51:42 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdd1069-42b0-40a2-9436-626ad048c3e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7dbbf5-8335-41e2-a7b1-1adc1fcac9b6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:51:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:51:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c106320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac9b61a-b69c-4e74-b2c4-04ca167b3ab5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3858538-d1aa-4be0-89c9-251c3a499c4f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57dd839-11e1-4543-8164-9396fe07da1c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff101a88-0c4c-4ada-926d-c7c18cad7491]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba805a-3634-4a96-8f19-e7d1b1962f89]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac145b9-123b-4d73-a515-50bdacf03fa0]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]
Nov 09 00:51:42 user nova-compute[74441]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.
Nov 09 00:51:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b3a054-6e42-428e-93ef-f3e2493a56b9]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== disconnect_volume: return (294ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:51:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-unplugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-unplugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:43 user nova-compute[74441]: WARNING nova.compute.manager [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-unplugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state active and task_state rebuilding.
Nov 09 00:51:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:51:43 user nova-compute[74441]: WARNING nova.compute.manager [req-7e9f756f-7aae-45a7-9ec9-d06f6ec9b3ff req-e6525762-86a3-4e2d-98f4-a47d2c2d348f service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state active and task_state rebuilding.
Nov 09 00:51:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:51:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:51:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:51:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:51:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:51:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:52:01 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8030MB free_disk=25.083526611328125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance destroyed successfully.
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-957887165',display_name='tempest-ServerActionsTestOtherA-server-613888714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-957887165',id=22,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3aiFj6myRk8LIGHu+y5KWZYh6GXAxxLvh2MQwbFHCRku5DTfO8A9kRI39wJav2cva+cH0ZsQWGClt63eKMxn4DJGhOyskYXv/gApv60ZizoZx3563A4DOFdnqBgIXM6A==',key_name='tempest-keypair-1946983635',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-9jeth6pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:51:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=e376efb6-383e-489f-8c1f-13628b496528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3761d8f8-ca, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d361bf96-1490-457e-bae6-f853281ff5a2) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:01 user nova-compute[74441]: INFO os_vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca')
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:52:01 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0eb59b29-20a0-4ba3-9ceb-a39e381f0fc5]: Unexpected error while running command.
Nov 09 00:52:01 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 00:52:01 user nova-compute[74441]: Exit code: 21
Nov 09 00:52:01 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 00:52:01 user nova-compute[74441]: Stderr: '' {{(pid=85292) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 09 00:52:01 user nova-compute[74441]: Traceback (most recent call last):
Nov 09 00:52:01 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 09 00:52:01 user nova-compute[74441]:     ret = func(*f_args, **f_kwargs)
Nov 09 00:52:01 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 09 00:52:01 user nova-compute[74441]:     return func(*args, **kwargs)
Nov 09 00:52:01 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 09 00:52:01 user nova-compute[74441]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 09 00:52:01 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 09 00:52:01 user nova-compute[74441]:     return putils.execute(on_execute=on_execute,
Nov 09 00:52:01 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 09 00:52:01 user nova-compute[74441]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 09 00:52:01 user nova-compute[74441]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 00:52:01 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 00:52:01 user nova-compute[74441]: Exit code: 21
Nov 09 00:52:01 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 00:52:01 user nova-compute[74441]: Stderr: ''
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb59b29-20a0-4ba3-9ceb-a39e381f0fc5]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Starting finish_migration {{(pid=74441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 00:52:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Creating image(s)
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 00:52:01 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 00:52:01 user nova-compute[74441]: Exit code: 21
Nov 09 00:52:01 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 00:52:01 user nova-compute[74441]: Stderr: ''
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4132, in _do_rebuild_instance
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 384, in rebuild
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 09 00:52:01 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74441) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== disconnect_volume: return (74ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:52:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Deleting instance files /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528_del
Nov 09 00:52:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Deletion of /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528_del complete
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Applying migration context for instance 670d138e-9fe7-40cc-810f-f88587f03bd8 as it has an incoming, in-progress migration fc210883-195f-4199-bd9b-6ec6d4dac04c. Migration status is post-migrating {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 00:52:01 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating resource usage from migration fc210883-195f-4199-bd9b-6ec6d4dac04c
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance cc9f8946-b092-417e-80b8-0f96b1e7912a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Migration fc210883-195f-4199-bd9b-6ec6d4dac04c is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk. size=21474836480 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:52:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:01 user nova-compute[74441]: INFO nova.virt.block_device [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Booting with volume 60b6a51b-67c0-439b-a371-1dfaef66106b at /dev/vdb
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.utils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[575dd70c-7d19-4861-8549-0e1f163b18c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a6d655-7fa1-45f9-b741-0e49bbd97b20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[147576e4-9fa5-472a-810d-c604166666ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799d4ec-56ae-4cb7-8d88-3082a862c66c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk 21474836480 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:52:02 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdab6e0b-d3b2-41a0-b24a-3178c8b1689d]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.utils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updating existing volume attachment record: bbb0206e-e90c-48b3-b910-1374e74cba85 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk 21474836480" returned: 0 in 0.050s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Ensure instance console log exists: /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start _get_guest_xml network_info=[{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '670d138e-9fe7-40cc-810f-f88587f03bd8', 'attached_at': '2023-11-09T00:52:01.000000', 'detached_at': '', 'volume_id': 'c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'serial': 'c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1'}, 'attachment_id': '208665fa-2d93-4126-a1be-3418cbeef5a2', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:52:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:52:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:34:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:52:02 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:52:02 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:52:02 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ceb9a-ec6c-482d-a10c-9d7fbae35c81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:52:02 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb81d06-d3e8-439f-805e-ca9206d9c147]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1] added
Nov 09 00:52:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[975a6df1-fdc2-4a42-8084-cb42b0e3ecc2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f1695b-3d91-4c3b-a6f4-7253af716d87]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENZMDPyg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENZMDPyg" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d81d66-1672-4494-8b9f-88c0537d2b4b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ENZMDPyg'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f86e9-08c2-432f-94fc-43a1e215063e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd4cd1-c104-4c31-92a1-d7edda2ff503]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:52:02 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:52:02 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:52:02 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 00:52:02 user nova-compute[74441]: 
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cfe46e-0756-4cf1-b539-2160f7819653]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]
Nov 09 00:52:02 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.
Nov 09 00:52:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ad568-2a10-4e37-950b-81c5637b00d0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5137443a-26b9-4cea-97c1-e3c533dcf851]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:52:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:52:02 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d241b64a-a339-4e1c-b874-4af9ae4cd990]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:52:02 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23831353130363561', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831353130363561', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:52:03 user nova-compute[74441]:   <uuid>670d138e-9fe7-40cc-810f-f88587f03bd8</uuid>
Nov 09 00:52:03 user nova-compute[74441]:   <name>instance-00000014</name>
Nov 09 00:52:03 user nova-compute[74441]:   <memory>2097152</memory>
Nov 09 00:52:03 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:52:03 user nova-compute[74441]:   <metadata>
Nov 09 00:52:03 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:52:03 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:52:03 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherB-server-1638891823</nova:name>
Nov 09 00:52:03 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:52:02</nova:creationTime>
Nov 09 00:52:03 user nova-compute[74441]:       <nova:flavor name="m1.small">
Nov 09 00:52:03 user nova-compute[74441]:         <nova:memory>2048</nova:memory>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:disk>20</nova:disk>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:52:03 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:52:03 user nova-compute[74441]:       <nova:owner>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:user uuid="fc13355f609c4b089a91c8e4cd68987a">tempest-ServerActionsTestOtherB-965415346-project-member</nova:user>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:project uuid="491dac50b8ab4e8cadadeae77c480e9a">tempest-ServerActionsTestOtherB-965415346</nova:project>
Nov 09 00:52:03 user nova-compute[74441]:       </nova:owner>
Nov 09 00:52:03 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:52:03 user nova-compute[74441]:       <nova:ports>
Nov 09 00:52:03 user nova-compute[74441]:         <nova:port uuid="22bdea8e-3969-48d2-bdc9-6e80f00a6542">
Nov 09 00:52:03 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 00:52:03 user nova-compute[74441]:         </nova:port>
Nov 09 00:52:03 user nova-compute[74441]:       </nova:ports>
Nov 09 00:52:03 user nova-compute[74441]:     </nova:instance>
Nov 09 00:52:03 user nova-compute[74441]:   </metadata>
Nov 09 00:52:03 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:52:03 user nova-compute[74441]:     <system>
Nov 09 00:52:03 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:52:03 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:52:03 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:52:03 user nova-compute[74441]:       <entry name="serial">670d138e-9fe7-40cc-810f-f88587f03bd8</entry>
Nov 09 00:52:03 user nova-compute[74441]:       <entry name="uuid">670d138e-9fe7-40cc-810f-f88587f03bd8</entry>
Nov 09 00:52:03 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:52:03 user nova-compute[74441]:     </system>
Nov 09 00:52:03 user nova-compute[74441]:   </sysinfo>
Nov 09 00:52:03 user nova-compute[74441]:   <os>
Nov 09 00:52:03 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:52:03 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:52:03 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:52:03 user nova-compute[74441]:   </os>
Nov 09 00:52:03 user nova-compute[74441]:   <features>
Nov 09 00:52:03 user nova-compute[74441]:     <acpi/>
Nov 09 00:52:03 user nova-compute[74441]:     <apic/>
Nov 09 00:52:03 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:52:03 user nova-compute[74441]:   </features>
Nov 09 00:52:03 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:52:03 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:52:03 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:52:03 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:52:03 user nova-compute[74441]:   </clock>
Nov 09 00:52:03 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:52:03 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:52:03 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:52:03 user nova-compute[74441]:   </cpu>
Nov 09 00:52:03 user nova-compute[74441]:   <devices>
Nov 09 00:52:03 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:52:03 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:52:03 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk"/>
Nov 09 00:52:03 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:52:03 user nova-compute[74441]:     </disk>
Nov 09 00:52:03 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:52:03 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:52:03 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 00:52:03 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:52:03 user nova-compute[74441]:       <serial>c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1</serial>
Nov 09 00:52:03 user nova-compute[74441]:     </disk>
Nov 09 00:52:03 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:52:03 user nova-compute[74441]:       <mac address="fa:16:3e:47:b1:f9"/>
Nov 09 00:52:03 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:52:03 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:52:03 user nova-compute[74441]:       <target dev="tap22bdea8e-39"/>
Nov 09 00:52:03 user nova-compute[74441]:     </interface>
Nov 09 00:52:03 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:52:03 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/console.log" append="off"/>
Nov 09 00:52:03 user nova-compute[74441]:     </serial>
Nov 09 00:52:03 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:52:03 user nova-compute[74441]:     <video>
Nov 09 00:52:03 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:52:03 user nova-compute[74441]:     </video>
Nov 09 00:52:03 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:52:03 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:52:03 user nova-compute[74441]:     </rng>
Nov 09 00:52:03 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:52:03 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:52:03 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:52:03 user nova-compute[74441]:     </memballoon>
Nov 09 00:52:03 user nova-compute[74441]:   </devices>
Nov 09 00:52:03 user nova-compute[74441]: </domain>
Nov 09 00:52:03 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:51:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-431562342-network", "vif_mac": "fa:16:3e:47:b1:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG os_vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d6ed055-dc89-5da8-8cda-79e0bd76cbd7', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22bdea8e-39, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22bdea8e-39, col_values=(('qos', UUID('cbec9ef8-1e70-45e7-ba33-be5c094345f7')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22bdea8e-39, col_values=(('external_ids', {'iface-id': '22bdea8e-3969-48d2-bdc9-6e80f00a6542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:b1:f9', 'vm-uuid': '670d138e-9fe7-40cc-810f-f88587f03bd8'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:03 user nova-compute[74441]: INFO os_vif [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39')
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:52:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] No VIF found with MAC fa:16:3e:47:b1:f9, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:52:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-b649f9d9-8350-4b76-bfa0-836f79757f13 req-d3e76081-a855-425c-806c-f2bc02023f1e service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b649f9d9-8350-4b76-bfa0-836f79757f13 req-d3e76081-a855-425c-806c-f2bc02023f1e service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b649f9d9-8350-4b76-bfa0-836f79757f13 req-d3e76081-a855-425c-806c-f2bc02023f1e service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b649f9d9-8350-4b76-bfa0-836f79757f13 req-d3e76081-a855-425c-806c-f2bc02023f1e service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-b649f9d9-8350-4b76-bfa0-836f79757f13 req-d3e76081-a855-425c-806c-f2bc02023f1e service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:05 user nova-compute[74441]: WARNING nova.compute.manager [req-b649f9d9-8350-4b76-bfa0-836f79757f13 req-d3e76081-a855-425c-806c-f2bc02023f1e service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state active and task_state resize_finish.
Nov 09 00:52:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:52:07 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance running successfully.
Nov 09 00:52:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Failed to set time: agent not configured {{(pid=74441) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8558352c-b6cc-4ca8-8ccb-bce3c966875f tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] finish_migration finished successfully. {{(pid=74441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-d124c2e0-e0b2-4f0d-addc-676024fccb1d req-f44ffcce-e70d-41e2-9868-e66f3a8ede8b service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d124c2e0-e0b2-4f0d-addc-676024fccb1d req-f44ffcce-e70d-41e2-9868-e66f3a8ede8b service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d124c2e0-e0b2-4f0d-addc-676024fccb1d req-f44ffcce-e70d-41e2-9868-e66f3a8ede8b service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d124c2e0-e0b2-4f0d-addc-676024fccb1d req-f44ffcce-e70d-41e2-9868-e66f3a8ede8b service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-d124c2e0-e0b2-4f0d-addc-676024fccb1d req-f44ffcce-e70d-41e2-9868-e66f3a8ede8b service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:07 user nova-compute[74441]: WARNING nova.compute.manager [req-d124c2e0-e0b2-4f0d-addc-676024fccb1d req-f44ffcce-e70d-41e2-9868-e66f3a8ede8b service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state active and task_state resize_finish.
Nov 09 00:52:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:52:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:52:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:52:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:41 user nova-compute[74441]: INFO nova.compute.manager [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Terminating instance
Nov 09 00:52:41 user nova-compute[74441]: DEBUG nova.compute.manager [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:52:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Creating image(s)
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e0bcd741-b88a-4cd2-86a5-0a9be790efd4 req-e9f3baef-33f6-477a-b52f-90d816468879 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-vif-unplugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e0bcd741-b88a-4cd2-86a5-0a9be790efd4 req-e9f3baef-33f6-477a-b52f-90d816468879 service nova] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e0bcd741-b88a-4cd2-86a5-0a9be790efd4 req-e9f3baef-33f6-477a-b52f-90d816468879 service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e0bcd741-b88a-4cd2-86a5-0a9be790efd4 req-e9f3baef-33f6-477a-b52f-90d816468879 service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e0bcd741-b88a-4cd2-86a5-0a9be790efd4 req-e9f3baef-33f6-477a-b52f-90d816468879 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] No waiting events found dispatching network-vif-unplugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-e0bcd741-b88a-4cd2-86a5-0a9be790efd4 req-e9f3baef-33f6-477a-b52f-90d816468879 service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-vif-unplugged-5afd2159-15d0-410e-9778-eb2b0c3c962c for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk 1073741824" returned: 0 in 0.068s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Instance destroyed successfully.
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lazy-loading 'resources' on Instance uuid cc9f8946-b092-417e-80b8-0f96b1e7912a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1183103633',display_name='tempest-VolumesAdminNegativeTest-server-1183103633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1183103633',id=13,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAv1zAuray+X/VAMIJqG06gqK4ibDBT3+rtLtgReSUofo5ybQSUELyoU/UYkeAcBdfCSUyRDWA0w5q8d//npvsqLr+neGIq5TBWCc72YY8dmKhEmPugHSAQCxnaqt8LSg==',key_name='tempest-keypair-1338366946',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:44:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09fe955c4cc64babb766d9c302cbcc9f',ramdisk_id='',reservation_id='r-cxxz9pfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-676102726',owner_user_name='tempest-VolumesAdminNegativeTest-676102726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='197592c74bf14d389b65648dffd05aa6',uuid=cc9f8946-b092-417e-80b8-0f96b1e7912a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converting VIF {"id": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "address": "fa:16:3e:eb:a7:16", "network": {"id": "acef134a-a286-40bf-a6b3-275320a179b1", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-394508812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09fe955c4cc64babb766d9c302cbcc9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5afd2159-15", "ovs_interfaceid": "5afd2159-15d0-410e-9778-eb2b0c3c962c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG os_vif [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5afd2159-15, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23541a25-ff45-458f-a021-f1a3121fd2fe) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:42 user nova-compute[74441]: INFO os_vif [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:a7:16,bridge_name='br-int',has_traffic_filtering=True,id=5afd2159-15d0-410e-9778-eb2b0c3c962c,network=Network(acef134a-a286-40bf-a6b3-275320a179b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5afd2159-15')
Nov 09 00:52:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Deleting instance files /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a_del
Nov 09 00:52:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Deletion of /opt/stack/data/nova/instances/cc9f8946-b092-417e-80b8-0f96b1e7912a_del complete
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:42 user nova-compute[74441]: INFO nova.compute.manager [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 00:52:42 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:52:42 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Cannot resize image /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Ensure instance console log exists: /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Start _get_guest_xml network_info=[{"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e376efb6-383e-489f-8c1f-13628b496528', 'attached_at': '', 'detached_at': '', 'volume_id': '60b6a51b-67c0-439b-a371-1dfaef66106b', 'serial': '60b6a51b-67c0-439b-a371-1dfaef66106b'}, 'attachment_id': 'bbb0206e-e90c-48b3-b910-1374e74cba85', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:52:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 00:52:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'vcpu_model' on Instance uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:52:43 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:52:43 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:52:43 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b449ab-6883-4c4a-9499-a8a16d5af4f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:52:43 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4fb008-97d6-4e6f-8e0e-2f77197e96ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b] added
Nov 09 00:52:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8656dc2-ce25-4a8b-8e1a-6b7d50dc9cff]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afabf6f-eef1-44f5-a604-8c7b65689402]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAefFJQu {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nAefFJQu" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d589f9-4cfa-451c-86c4-e32cfc5e470a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nAefFJQu'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[33711142-32ea-4b1d-a6da-945d7c4b3588]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef9581d-8f50-4d17-be53-8e0917f5c784]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:52:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:52:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a832ec9-a47a-40af-a9d6-21dbf1d234dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]
Nov 09 00:52:43 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.
Nov 09 00:52:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3ea598-855c-42c7-895d-bc42b3f3065f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[016bed7d-951c-490f-996d-9f0fa8e98fed]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:52:43 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:52:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:52:43 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:52:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbced48-2c5b-487e-af46-3e22c332adda]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:52:43 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Took 0.89 seconds to deallocate network for instance.
Nov 09 00:52:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-0d1ce818-4661-45d1-ab08-7e9489abecb3 req-e388add7-1a1e-41a6-ba6e-53de7a497c3f service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-vif-deleted-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-1527039d-06dd-4752-b8f7-d5207fa297d3 req-0ad9fefa-fd3f-4aba-b3fd-7e6bc4d001ba service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received event network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1527039d-06dd-4752-b8f7-d5207fa297d3 req-0ad9fefa-fd3f-4aba-b3fd-7e6bc4d001ba service nova] Acquiring lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1527039d-06dd-4752-b8f7-d5207fa297d3 req-0ad9fefa-fd3f-4aba-b3fd-7e6bc4d001ba service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1527039d-06dd-4752-b8f7-d5207fa297d3 req-0ad9fefa-fd3f-4aba-b3fd-7e6bc4d001ba service nova] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-1527039d-06dd-4752-b8f7-d5207fa297d3 req-0ad9fefa-fd3f-4aba-b3fd-7e6bc4d001ba service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] No waiting events found dispatching network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:44 user nova-compute[74441]: WARNING nova.compute.manager [req-1527039d-06dd-4752-b8f7-d5207fa297d3 req-0ad9fefa-fd3f-4aba-b3fd-7e6bc4d001ba service nova] [instance: cc9f8946-b092-417e-80b8-0f96b1e7912a] Received unexpected event network-vif-plugged-5afd2159-15d0-410e-9778-eb2b0c3c962c for instance with vm_state deleted and task_state None.
Nov 09 00:52:44 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Deleted allocations for instance cc9f8946-b092-417e-80b8-0f96b1e7912a
Nov 09 00:52:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edaeb47e-559e-42a3-80a9-306116cdf4ba tempest-VolumesAdminNegativeTest-676102726 tempest-VolumesAdminNegativeTest-676102726-project-member] Lock "cc9f8946-b092-417e-80b8-0f96b1e7912a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23839353036356433', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839353036356433', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-957887165',display_name='tempest-ServerActionsTestOtherA-server-613888714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-957887165',id=22,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3aiFj6myRk8LIGHu+y5KWZYh6GXAxxLvh2MQwbFHCRku5DTfO8A9kRI39wJav2cva+cH0ZsQWGClt63eKMxn4DJGhOyskYXv/gApv60ZizoZx3563A4DOFdnqBgIXM6A==',key_name='tempest-keypair-1946983635',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-9jeth6pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=e376efb6-383e-489f-8c1f-13628b496528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:52:44 user nova-compute[74441]:   <uuid>e376efb6-383e-489f-8c1f-13628b496528</uuid>
Nov 09 00:52:44 user nova-compute[74441]:   <name>instance-00000016</name>
Nov 09 00:52:44 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:52:44 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:52:44 user nova-compute[74441]:   <metadata>
Nov 09 00:52:44 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:52:44 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:52:44 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherA-server-613888714</nova:name>
Nov 09 00:52:44 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:52:43</nova:creationTime>
Nov 09 00:52:44 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:52:44 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:52:44 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:52:44 user nova-compute[74441]:       <nova:owner>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:user uuid="dee4ca1b1a8d432d943ba7bf20f41f1b">tempest-ServerActionsTestOtherA-1357980906-project-member</nova:user>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:project uuid="24c24e7fc6e24dd0bc5c8ca3bfd1166f">tempest-ServerActionsTestOtherA-1357980906</nova:project>
Nov 09 00:52:44 user nova-compute[74441]:       </nova:owner>
Nov 09 00:52:44 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:52:44 user nova-compute[74441]:       <nova:ports>
Nov 09 00:52:44 user nova-compute[74441]:         <nova:port uuid="3761d8f8-ca06-4ab0-8a0c-fe7561451cb9">
Nov 09 00:52:44 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 00:52:44 user nova-compute[74441]:         </nova:port>
Nov 09 00:52:44 user nova-compute[74441]:       </nova:ports>
Nov 09 00:52:44 user nova-compute[74441]:     </nova:instance>
Nov 09 00:52:44 user nova-compute[74441]:   </metadata>
Nov 09 00:52:44 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:52:44 user nova-compute[74441]:     <system>
Nov 09 00:52:44 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:52:44 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:52:44 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:52:44 user nova-compute[74441]:       <entry name="serial">e376efb6-383e-489f-8c1f-13628b496528</entry>
Nov 09 00:52:44 user nova-compute[74441]:       <entry name="uuid">e376efb6-383e-489f-8c1f-13628b496528</entry>
Nov 09 00:52:44 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:52:44 user nova-compute[74441]:     </system>
Nov 09 00:52:44 user nova-compute[74441]:   </sysinfo>
Nov 09 00:52:44 user nova-compute[74441]:   <os>
Nov 09 00:52:44 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:52:44 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:52:44 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:52:44 user nova-compute[74441]:   </os>
Nov 09 00:52:44 user nova-compute[74441]:   <features>
Nov 09 00:52:44 user nova-compute[74441]:     <acpi/>
Nov 09 00:52:44 user nova-compute[74441]:     <apic/>
Nov 09 00:52:44 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:52:44 user nova-compute[74441]:   </features>
Nov 09 00:52:44 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:52:44 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:52:44 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:52:44 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:52:44 user nova-compute[74441]:   </clock>
Nov 09 00:52:44 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:52:44 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:52:44 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:52:44 user nova-compute[74441]:   </cpu>
Nov 09 00:52:44 user nova-compute[74441]:   <devices>
Nov 09 00:52:44 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:52:44 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:52:44 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk"/>
Nov 09 00:52:44 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:52:44 user nova-compute[74441]:     </disk>
Nov 09 00:52:44 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:52:44 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:52:44 user nova-compute[74441]:       <source dev="/dev/sdc"/>
Nov 09 00:52:44 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:52:44 user nova-compute[74441]:       <serial>60b6a51b-67c0-439b-a371-1dfaef66106b</serial>
Nov 09 00:52:44 user nova-compute[74441]:     </disk>
Nov 09 00:52:44 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:52:44 user nova-compute[74441]:       <mac address="fa:16:3e:33:3a:76"/>
Nov 09 00:52:44 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:52:44 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:52:44 user nova-compute[74441]:       <target dev="tap3761d8f8-ca"/>
Nov 09 00:52:44 user nova-compute[74441]:     </interface>
Nov 09 00:52:44 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:52:44 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/console.log" append="off"/>
Nov 09 00:52:44 user nova-compute[74441]:     </serial>
Nov 09 00:52:44 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:52:44 user nova-compute[74441]:     <video>
Nov 09 00:52:44 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:52:44 user nova-compute[74441]:     </video>
Nov 09 00:52:44 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:52:44 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:52:44 user nova-compute[74441]:     </rng>
Nov 09 00:52:44 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:52:44 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:52:44 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:52:44 user nova-compute[74441]:     </memballoon>
Nov 09 00:52:44 user nova-compute[74441]:   </devices>
Nov 09 00:52:44 user nova-compute[74441]: </domain>
Nov 09 00:52:44 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-957887165',display_name='tempest-ServerActionsTestOtherA-server-613888714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-957887165',id=22,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3aiFj6myRk8LIGHu+y5KWZYh6GXAxxLvh2MQwbFHCRku5DTfO8A9kRI39wJav2cva+cH0ZsQWGClt63eKMxn4DJGhOyskYXv/gApv60ZizoZx3563A4DOFdnqBgIXM6A==',key_name='tempest-keypair-1946983635',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-9jeth6pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=e376efb6-383e-489f-8c1f-13628b496528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG os_vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f192566-a46f-5dfa-b961-4d84da738af8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3761d8f8-ca, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3761d8f8-ca, col_values=(('qos', UUID('dc5536a2-13ce-4db4-8df8-3756473cf7c8')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3761d8f8-ca, col_values=(('external_ids', {'iface-id': '3761d8f8-ca06-4ab0-8a0c-fe7561451cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:3a:76', 'vm-uuid': 'e376efb6-383e-489f-8c1f-13628b496528'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:44 user nova-compute[74441]: INFO os_vif [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca')
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:52:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No VIF found with MAC fa:16:3e:33:3a:76, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:52:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-34bdd85a-db3c-4de7-8240-0628faa34ccd req-f34c818b-d043-4356-b6f9-d71ccb804437 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-34bdd85a-db3c-4de7-8240-0628faa34ccd req-f34c818b-d043-4356-b6f9-d71ccb804437 service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-34bdd85a-db3c-4de7-8240-0628faa34ccd req-f34c818b-d043-4356-b6f9-d71ccb804437 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-34bdd85a-db3c-4de7-8240-0628faa34ccd req-f34c818b-d043-4356-b6f9-d71ccb804437 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-34bdd85a-db3c-4de7-8240-0628faa34ccd req-f34c818b-d043-4356-b6f9-d71ccb804437 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:46 user nova-compute[74441]: WARNING nova.compute.manager [req-34bdd85a-db3c-4de7-8240-0628faa34ccd req-f34c818b-d043-4356-b6f9-d71ccb804437 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 00:52:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:52:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance spawned successfully.
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-67feca3c-a8b1-4ccb-853e-37d76266eb96 req-1e9a14dc-b530-470d-9feb-8efe5e09a754 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-67feca3c-a8b1-4ccb-853e-37d76266eb96 req-1e9a14dc-b530-470d-9feb-8efe5e09a754 service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-67feca3c-a8b1-4ccb-853e-37d76266eb96 req-1e9a14dc-b530-470d-9feb-8efe5e09a754 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-67feca3c-a8b1-4ccb-853e-37d76266eb96 req-1e9a14dc-b530-470d-9feb-8efe5e09a754 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-67feca3c-a8b1-4ccb-853e-37d76266eb96 req-1e9a14dc-b530-470d-9feb-8efe5e09a754 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:48 user nova-compute[74441]: WARNING nova.compute.manager [req-67feca3c-a8b1-4ccb-853e-37d76266eb96 req-1e9a14dc-b530-470d-9feb-8efe5e09a754 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74441) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 09 00:52:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8e2f12c7-ecfe-4ad9-bb20-c4844915558a tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:52 user nova-compute[74441]: INFO nova.compute.manager [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Unrescuing
Nov 09 00:52:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:52:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:52:52 user nova-compute[74441]: DEBUG nova.network.neutron [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'flavor' on Instance uuid 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.objects.instance [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'flavor' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:53 user nova-compute[74441]: INFO nova.compute.manager [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Attaching volume dabff4cd-a099-4e2c-9673-cc0756573a4f to /dev/vdb
Nov 09 00:52:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd419730-c270-479a-93e5-97ea133a1c73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb5b056-8c83-4e92-9d93-6802292897e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eea1c2-dbb5-4a94-93f1-fbd6de148988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d50d7-c76b-42b1-a741-ae9cc554eea4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:52:53 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdfe1e2-0e8b-4595-908f-c9c773429907]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating existing volume attachment record: 48c6a0c1-051a-4664-9ffd-ec75dca16482 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updating instance_info_cache with network_info: [{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-39056689-1b70-4a1f-9e5a-a75548bac703 req-2c71beb6-0d03-48b7-a0a9-5fab25b7ed90 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-39056689-1b70-4a1f-9e5a-a75548bac703 req-2c71beb6-0d03-48b7-a0a9-5fab25b7ed90 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-39056689-1b70-4a1f-9e5a-a75548bac703 req-2c71beb6-0d03-48b7-a0a9-5fab25b7ed90 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-39056689-1b70-4a1f-9e5a-a75548bac703 req-2c71beb6-0d03-48b7-a0a9-5fab25b7ed90 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-39056689-1b70-4a1f-9e5a-a75548bac703 req-2c71beb6-0d03-48b7-a0a9-5fab25b7ed90 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:53 user nova-compute[74441]: WARNING nova.compute.manager [req-39056689-1b70-4a1f-9e5a-a75548bac703 req-2c71beb6-0d03-48b7-a0a9-5fab25b7ed90 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:52:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance destroyed successfully.
Nov 09 00:52:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-500bcd58-e144-489d-965c-3e1f3bbbc598 req-c316f4a6-92d8-4de8-9454-7474d4c0ed63 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-500bcd58-e144-489d-965c-3e1f3bbbc598 req-c316f4a6-92d8-4de8-9454-7474d4c0ed63 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-500bcd58-e144-489d-965c-3e1f3bbbc598 req-c316f4a6-92d8-4de8-9454-7474d4c0ed63 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-500bcd58-e144-489d-965c-3e1f3bbbc598 req-c316f4a6-92d8-4de8-9454-7474d4c0ed63 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-500bcd58-e144-489d-965c-3e1f3bbbc598 req-c316f4a6-92d8-4de8-9454-7474d4c0ed63 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:56 user nova-compute[74441]: WARNING nova.compute.manager [req-500bcd58-e144-489d-965c-3e1f3bbbc598 req-c316f4a6-92d8-4de8-9454-7474d4c0ed63 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:52:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:52:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:58 user nova-compute[74441]: WARNING nova.compute.manager [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:52:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:52:58 user nova-compute[74441]: WARNING nova.compute.manager [req-03a423eb-80fb-43a6-bf90-705e0ab39a3c req-906519c8-1b38-4be1-b271-84afbb2ac3d5 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-343e5d15-b1ed-4e6e-a825-26d1206a443e tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:52:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:53:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:53:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8067MB free_disk=25.126529693603516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Applying migration context for instance 670d138e-9fe7-40cc-810f-f88587f03bd8 as it has an incoming, in-progress migration fc210883-195f-4199-bd9b-6ec6d4dac04c. Migration status is finished {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 00:53:02 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating resource usage from migration fc210883-195f-4199-bd9b-6ec6d4dac04c
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Migration fc210883-195f-4199-bd9b-6ec6d4dac04c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:53:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:53:03 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:53:03 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:53:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:53:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.901s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:53:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwjhfruO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:53:19 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:53:19 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:53:19 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32fe839-7746-422f-9c59-31f59f20861e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:53:19 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d032d-c1c5-494c-b706-36d253579b44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f] added
Nov 09 00:53:19 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c699df-05d2-4484-ace0-e6620c3c1624]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5154d2-b9ca-4d5c-b573-14291e14b362]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HwjhfruO {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HwjhfruO" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e68ad-23b1-486d-a9f9-7427198aceb7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HwjhfruO'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[338c4026-467d-4ab2-bfca-d250c7d80162]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9834e5a-e8f5-47da-b2af-1fb31bb5d384]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:53:20 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:53:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:53:20 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:53:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b4153-bc3c-450b-b605-4b18a09d72ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260]
Nov 09 00:53:20 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260] successful.
Nov 09 00:53:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[511deb1f-3a8a-46ba-be8c-860f903e43c3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1b009-5710-4d49-ad95-9c84d11e83fe]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:53:20 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:53:20 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:53:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:53:20 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:53:20 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:53:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be258721-7c76-4f96-a550-0d19717d6014]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:53:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwjhfruO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23865333937643133', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865333937643133', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'flavor' on Instance uuid 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:53:21 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:53:21 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 00:53:21 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:53:21 user nova-compute[74441]:   <serial>dabff4cd-a099-4e2c-9673-cc0756573a4f</serial>
Nov 09 00:53:21 user nova-compute[74441]: </disk>
Nov 09 00:53:21 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] No VIF found with MAC fa:16:3e:a6:14:cd, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:53:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c3940a6-5b35-4422-bd49-8214e785aa06 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.246s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:23 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Port 22bdea8e-3969-48d2-bdc9-6e80f00a6542 binding to destination host user is already ACTIVE {{(pid=74441) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 00:53:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:23 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Creating tmpfile /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/tmpt12opptl to verify with other compute node that the instance is on the same shared storage. {{(pid=74441) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing instance network info cache due to event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-e6642bad-9a6f-4b9c-bf68-38fd194661ff req-690bb088-b230-44b1-b110-71d6ea8c19d6 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e6642bad-9a6f-4b9c-bf68-38fd194661ff req-690bb088-b230-44b1-b110-71d6ea8c19d6 service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e6642bad-9a6f-4b9c-bf68-38fd194661ff req-690bb088-b230-44b1-b110-71d6ea8c19d6 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e6642bad-9a6f-4b9c-bf68-38fd194661ff req-690bb088-b230-44b1-b110-71d6ea8c19d6 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-e6642bad-9a6f-4b9c-bf68-38fd194661ff req-690bb088-b230-44b1-b110-71d6ea8c19d6 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:25 user nova-compute[74441]: WARNING nova.compute.manager [req-e6642bad-9a6f-4b9c-bf68-38fd194661ff req-690bb088-b230-44b1-b110-71d6ea8c19d6 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state resized and task_state resize_reverting.
Nov 09 00:53:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance destroyed successfully.
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'resources' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22bdea8e-39, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbec9ef8-1e70-45e7-ba33-be5c094345f7) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:25 user nova-compute[74441]: INFO os_vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39')
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:53:25 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85b61c6-e492-413e-924d-ce13085fb265]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:53:25 user nova-compute[74441]: No targets found.
Nov 09 00:53:25 user nova-compute[74441]: iSNS:
Nov 09 00:53:25 user nova-compute[74441]: No targets found.
Nov 09 00:53:25 user nova-compute[74441]: STATIC:
Nov 09 00:53:25 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1
Nov 09 00:53:25 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:53:25 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:53:25 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b
Nov 09 00:53:25 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:53:25 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:53:25 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f
Nov 09 00:53:25 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:53:25 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:53:25 user nova-compute[74441]: FIRMWARE:
Nov 09 00:53:25 user nova-compute[74441]: No targets found.
Nov 09 00:53:25 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:53:25 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:53:25 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb11c61-727f-4deb-85cf-4965584488d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d99bb-4559-4f09-9186-3c76964e5426]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:53:25 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:53:25 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:53:25 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:53:25 user nova-compute[74441]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:53:25 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:53:25 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c41ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updated VIF entry in instance network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8009302-b695-4d1b-9a4f-f9a1b1b2e44e req-e9e8371e-b34c-4c57-adfd-ad72b1889e9c service nova] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[96255f94-23cd-4d93-8e39-53851bf0b87b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf5959a-e360-4132-8619-7148bbc345a3]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[16058461-ba07-4103-80a6-ac2717f46567]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a0c87-bd48-4494-8f8c-b3dc4600eb40]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad124b0a-7ddf-468c-a929-8be5af9d2ca8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977e6c0-4395-4f18-b23c-d707fe93ddd8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]
Nov 09 00:53:25 user nova-compute[74441]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.
Nov 09 00:53:25 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58458a-4f30-4034-8518-1f9747ce4e67]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== disconnect_volume: return (309ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:53:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:53:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'migration_context' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.objects.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Object Instance<670d138e-9fe7-40cc-810f-f88587f03bd8> lazy-loaded attributes: resources,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-63b97fd5-f16d-46af-aaa1-55e611073f3a req-73dc2a26-0c81-45d9-9819-95d3e9342cfe service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-63b97fd5-f16d-46af-aaa1-55e611073f3a req-73dc2a26-0c81-45d9-9819-95d3e9342cfe service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-63b97fd5-f16d-46af-aaa1-55e611073f3a req-73dc2a26-0c81-45d9-9819-95d3e9342cfe service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-63b97fd5-f16d-46af-aaa1-55e611073f3a req-73dc2a26-0c81-45d9-9819-95d3e9342cfe service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-63b97fd5-f16d-46af-aaa1-55e611073f3a req-73dc2a26-0c81-45d9-9819-95d3e9342cfe service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:27 user nova-compute[74441]: WARNING nova.compute.manager [req-63b97fd5-f16d-46af-aaa1-55e611073f3a req-73dc2a26-0c81-45d9-9819-95d3e9342cfe service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state resized and task_state resize_reverting.
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.394s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:27 user nova-compute[74441]: INFO nova.compute.manager [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Swapping old allocation on dict_keys(['72c49dde-a35c-4022-97fb-5b646dea5c73']) held by migration fc210883-195f-4199-bd9b-6ec6d4dac04c for instance
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Overwriting current allocation {'allocations': {'72c49dde-a35c-4022-97fb-5b646dea5c73': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 31}}, 'project_id': '491dac50b8ab4e8cadadeae77c480e9a', 'user_id': 'fc13355f609c4b089a91c8e4cd68987a', 'consumer_generation': 1} on consumer 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing instance network info cache due to event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:53:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updated VIF entry in instance network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4692cf07-b9dc-4e53-8764-01f54d603f54 req-0299c6be-7dec-4322-b4b3-f1d9c4ae4f59 service nova] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:28 user nova-compute[74441]: INFO nova.compute.manager [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Rebooting instance
Nov 09 00:53:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG os_brick.utils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be258c7a-662b-4980-8b77-264d6974d9bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec3523-a50f-4d33-8428-102cf47ca3ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f538643c-c670-4c77-898e-a5c8639895a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7324aa54-46e9-4820-b9b5-8d3967b92d03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:53:28 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e80cee-1d35-4432-8e9c-91c87976701c]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG os_brick.utils [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG nova.network.neutron [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:53:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7f5174d7-3900-46a2-bd39-fe50cf8b10c4 req-fcf1884e-7721-4513-b971-e44b74c1db4d service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-unplugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7f5174d7-3900-46a2-bd39-fe50cf8b10c4 req-fcf1884e-7721-4513-b971-e44b74c1db4d service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7f5174d7-3900-46a2-bd39-fe50cf8b10c4 req-fcf1884e-7721-4513-b971-e44b74c1db4d service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7f5174d7-3900-46a2-bd39-fe50cf8b10c4 req-fcf1884e-7721-4513-b971-e44b74c1db4d service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7f5174d7-3900-46a2-bd39-fe50cf8b10c4 req-fcf1884e-7721-4513-b971-e44b74c1db4d service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-unplugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:31 user nova-compute[74441]: WARNING nova.compute.manager [req-7f5174d7-3900-46a2-bd39-fe50cf8b10c4 req-fcf1884e-7721-4513-b971-e44b74c1db4d service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-unplugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state active and task_state reboot_started.
Nov 09 00:53:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance shutdown successfully.
Nov 09 00:53:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a37647e-0564-487d-9c66-0ab06a130975 req-0e79b360-bfd5-48af-842c-4e5bae607275 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a37647e-0564-487d-9c66-0ab06a130975 req-0e79b360-bfd5-48af-842c-4e5bae607275 service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a37647e-0564-487d-9c66-0ab06a130975 req-0e79b360-bfd5-48af-842c-4e5bae607275 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a37647e-0564-487d-9c66-0ab06a130975 req-0e79b360-bfd5-48af-842c-4e5bae607275 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a37647e-0564-487d-9c66-0ab06a130975 req-0e79b360-bfd5-48af-842c-4e5bae607275 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:33 user nova-compute[74441]: WARNING nova.compute.manager [req-3a37647e-0564-487d-9c66-0ab06a130975 req-0e79b360-bfd5-48af-842c-4e5bae607275 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state active and task_state reboot_started.
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:35 user nova-compute[74441]: WARNING nova.compute.manager [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state active and task_state reboot_started.
Nov 09 00:53:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:35 user nova-compute[74441]: WARNING nova.compute.manager [req-b53458ce-b498-4db7-9e22-739d8431da22 req-c32dfa82-3bf5-46cb-bf59-27adb091a5d8 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state active and task_state reboot_started.
Nov 09 00:53:35 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance running successfully.
Nov 09 00:53:35 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance soft rebooted successfully.
Nov 09 00:53:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-72c00eed-fc71-4dde-b940-3913c7e9be74 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.500s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:53:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:52 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:53:52 user nova-compute[74441]: INFO nova.compute.claims [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Claim successful on node user
Nov 09 00:53:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:53:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.policy [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9741a4f427124857be6d3d1f1e512eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33fe89e4a824e22a4bea354a547302f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:53:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Creating image(s)
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-670d138e-9fe7-40cc-810f-f88587f03bd8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk 1073741824" returned: 0 in 0.052s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG nova.network.neutron [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Successfully created port: 494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Cannot resize image /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Successfully updated port: 494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing instance network info cache due to event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance network_info: |[{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.neutron [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Start _get_guest_xml network_info=[{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:53:55 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:53:55 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-19428943',display_name='tempest-ServerStableDeviceRescueTest-server-19428943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-19428943',id=25,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4LPSIna8kft7F4sBbm/duxspyUfEVb9REdJOUO2pZWntMsgKir3VHMUe6SlTp8yatezmObML5DzdDAQflmKIKLSd0OQpmkHn0ooQSn2FtV8M9rMw7LYrkrTquMBagW9w==',key_name='tempest-keypair-496424780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b33fe89e4a824e22a4bea354a547302f',ramdisk_id='',reservation_id='r-1hwhh3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1228913245',owner_user_name='tempest-ServerStableDeviceRescueTest-1228913245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741a4f427124857be6d3d1f1e512eb0',uuid=b2c005b6-7adc-45e8-8539-8fd4306051d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converting VIF {"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:53:55 user nova-compute[74441]:   <uuid>b2c005b6-7adc-45e8-8539-8fd4306051d3</uuid>
Nov 09 00:53:55 user nova-compute[74441]:   <name>instance-00000019</name>
Nov 09 00:53:55 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:53:55 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:53:55 user nova-compute[74441]:   <metadata>
Nov 09 00:53:55 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:53:55 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:53:55 user nova-compute[74441]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-19428943</nova:name>
Nov 09 00:53:55 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:53:55</nova:creationTime>
Nov 09 00:53:55 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:53:55 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:53:55 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:53:55 user nova-compute[74441]:       <nova:owner>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:user uuid="9741a4f427124857be6d3d1f1e512eb0">tempest-ServerStableDeviceRescueTest-1228913245-project-member</nova:user>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:project uuid="b33fe89e4a824e22a4bea354a547302f">tempest-ServerStableDeviceRescueTest-1228913245</nova:project>
Nov 09 00:53:55 user nova-compute[74441]:       </nova:owner>
Nov 09 00:53:55 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:53:55 user nova-compute[74441]:       <nova:ports>
Nov 09 00:53:55 user nova-compute[74441]:         <nova:port uuid="494268cb-cba1-478a-a7a2-7657f2134dd5">
Nov 09 00:53:55 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 00:53:55 user nova-compute[74441]:         </nova:port>
Nov 09 00:53:55 user nova-compute[74441]:       </nova:ports>
Nov 09 00:53:55 user nova-compute[74441]:     </nova:instance>
Nov 09 00:53:55 user nova-compute[74441]:   </metadata>
Nov 09 00:53:55 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:53:55 user nova-compute[74441]:     <system>
Nov 09 00:53:55 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:53:55 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:53:55 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:53:55 user nova-compute[74441]:       <entry name="serial">b2c005b6-7adc-45e8-8539-8fd4306051d3</entry>
Nov 09 00:53:55 user nova-compute[74441]:       <entry name="uuid">b2c005b6-7adc-45e8-8539-8fd4306051d3</entry>
Nov 09 00:53:55 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:53:55 user nova-compute[74441]:     </system>
Nov 09 00:53:55 user nova-compute[74441]:   </sysinfo>
Nov 09 00:53:55 user nova-compute[74441]:   <os>
Nov 09 00:53:55 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:53:55 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:53:55 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:53:55 user nova-compute[74441]:   </os>
Nov 09 00:53:55 user nova-compute[74441]:   <features>
Nov 09 00:53:55 user nova-compute[74441]:     <acpi/>
Nov 09 00:53:55 user nova-compute[74441]:     <apic/>
Nov 09 00:53:55 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:53:55 user nova-compute[74441]:   </features>
Nov 09 00:53:55 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:53:55 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:53:55 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:53:55 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:53:55 user nova-compute[74441]:   </clock>
Nov 09 00:53:55 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:53:55 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:53:55 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:53:55 user nova-compute[74441]:   </cpu>
Nov 09 00:53:55 user nova-compute[74441]:   <devices>
Nov 09 00:53:55 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:53:55 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:53:55 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk"/>
Nov 09 00:53:55 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:53:55 user nova-compute[74441]:     </disk>
Nov 09 00:53:55 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:53:55 user nova-compute[74441]:       <mac address="fa:16:3e:eb:16:fe"/>
Nov 09 00:53:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:53:55 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:53:55 user nova-compute[74441]:       <target dev="tap494268cb-cb"/>
Nov 09 00:53:55 user nova-compute[74441]:     </interface>
Nov 09 00:53:55 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:53:55 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/console.log" append="off"/>
Nov 09 00:53:55 user nova-compute[74441]:     </serial>
Nov 09 00:53:55 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:53:55 user nova-compute[74441]:     <video>
Nov 09 00:53:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:53:55 user nova-compute[74441]:     </video>
Nov 09 00:53:55 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:53:55 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:53:55 user nova-compute[74441]:     </rng>
Nov 09 00:53:55 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:53:55 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:53:55 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:53:55 user nova-compute[74441]:     </memballoon>
Nov 09 00:53:55 user nova-compute[74441]:   </devices>
Nov 09 00:53:55 user nova-compute[74441]: </domain>
Nov 09 00:53:55 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-19428943',display_name='tempest-ServerStableDeviceRescueTest-server-19428943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-19428943',id=25,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4LPSIna8kft7F4sBbm/duxspyUfEVb9REdJOUO2pZWntMsgKir3VHMUe6SlTp8yatezmObML5DzdDAQflmKIKLSd0OQpmkHn0ooQSn2FtV8M9rMw7LYrkrTquMBagW9w==',key_name='tempest-keypair-496424780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b33fe89e4a824e22a4bea354a547302f',ramdisk_id='',reservation_id='r-1hwhh3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1228913245',owner_user_name='tempest-ServerStableDeviceRescueTest-1228913245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741a4f427124857be6d3d1f1e512eb0',uuid=b2c005b6-7adc-45e8-8539-8fd4306051d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converting VIF {"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG os_vif [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89935b04-f086-5aa6-91e2-ef58b22e8515', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap494268cb-cb, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap494268cb-cb, col_values=(('qos', UUID('91709c1b-34a9-4b42-8fed-1c41a1122938')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap494268cb-cb, col_values=(('external_ids', {'iface-id': '494268cb-cba1-478a-a7a2-7657f2134dd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:16:fe', 'vm-uuid': 'b2c005b6-7adc-45e8-8539-8fd4306051d3'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:53:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:55 user nova-compute[74441]: INFO os_vif [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb')
Nov 09 00:53:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:53:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No VIF found with MAC fa:16:3e:eb:16:fe, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:53:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updated VIF entry in instance network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:53:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:53:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-75c8c893-a27d-49cd-9ced-74ce9f47a67c req-b0fd9278-97a6-4804-b82b-4818bb0296c6 service nova] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c28bef4f-f9cb-411d-9384-fba739591d58 req-6ba58480-8f48-4f60-a33f-890a5abcf9dc service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c28bef4f-f9cb-411d-9384-fba739591d58 req-6ba58480-8f48-4f60-a33f-890a5abcf9dc service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c28bef4f-f9cb-411d-9384-fba739591d58 req-6ba58480-8f48-4f60-a33f-890a5abcf9dc service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c28bef4f-f9cb-411d-9384-fba739591d58 req-6ba58480-8f48-4f60-a33f-890a5abcf9dc service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c28bef4f-f9cb-411d-9384-fba739591d58 req-6ba58480-8f48-4f60-a33f-890a5abcf9dc service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:57 user nova-compute[74441]: WARNING nova.compute.manager [req-c28bef4f-f9cb-411d-9384-fba739591d58 req-6ba58480-8f48-4f60-a33f-890a5abcf9dc service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state building and task_state spawning.
Nov 09 00:53:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-0c0ce3bf-e406-4457-a0c2-6bb9a3e914a9 req-2558beb2-8be7-4e6b-afc0-4b329b4b2a51 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0c0ce3bf-e406-4457-a0c2-6bb9a3e914a9 req-2558beb2-8be7-4e6b-afc0-4b329b4b2a51 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0c0ce3bf-e406-4457-a0c2-6bb9a3e914a9 req-2558beb2-8be7-4e6b-afc0-4b329b4b2a51 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0c0ce3bf-e406-4457-a0c2-6bb9a3e914a9 req-2558beb2-8be7-4e6b-afc0-4b329b4b2a51 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:53:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-0c0ce3bf-e406-4457-a0c2-6bb9a3e914a9 req-2558beb2-8be7-4e6b-afc0-4b329b4b2a51 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:53:59 user nova-compute[74441]: WARNING nova.compute.manager [req-0c0ce3bf-e406-4457-a0c2-6bb9a3e914a9 req-2558beb2-8be7-4e6b-afc0-4b329b4b2a51 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state building and task_state spawning.
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:54:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance spawned successfully.
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:00 user nova-compute[74441]: INFO nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:54:00 user nova-compute[74441]: INFO nova.compute.manager [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Took 7.92 seconds to build instance.
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-bdec79a9-aeaf-471f-9222-ef6ed1daff9d tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.082s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:54:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:54:02 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:54:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=25.085498809814453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 378ca4d6-d23b-48f1-af42-c31978672971 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:02 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 00:54:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 00:54:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Starting finish_revert_migration {{(pid=74441) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start _get_guest_xml network_info=[{"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '670d138e-9fe7-40cc-810f-f88587f03bd8', 'attached_at': '2023-11-09T00:54:08.000000', 'detached_at': '', 'volume_id': 'c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'serial': 'c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1'}, 'attachment_id': '21c8bc78-1717-497c-9e9f-992db1214a89', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:54:08 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:54:08 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'vcpu_model' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:54:08 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:54:08 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:54:08 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7bd9d1-e042-46de-a4bd-0b8973f6ce7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:54:08 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae63bd-b577-49e4-bb20-4e3427b40931]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1] added
Nov 09 00:54:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df9023f-2aac-4191-972c-c2df594aac71]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d048e28e-e9cc-48dc-8eb3-7b6b15f80e2f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENZMDPyg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ENZMDPyg" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[db129a60-6757-4dc3-a8ce-5e31884d969b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ENZMDPyg'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c249bb28-faf2-42cb-acdf-1a05374bbf1f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cafba9e-3be1-4bdb-8ca7-b42809b261cf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:54:08 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:54:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:54:08 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:54:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebac8ee-b51e-4425-b241-ed432a23a686]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]
Nov 09 00:54:08 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.
Nov 09 00:54:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4084433-b849-4083-805e-dfdb26bbe5a4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[090442a0-2921-478b-b7b5-dd041cc1bbf9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:54:08 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:54:08 user nova-compute[74441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:54:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:54:08 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:54:08 user nova-compute[74441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:54:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0bfdd1-6869-4113-8979-dbe22f071302]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:54:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23831353130363561', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831353130363561', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:54:09 user nova-compute[74441]:   <uuid>670d138e-9fe7-40cc-810f-f88587f03bd8</uuid>
Nov 09 00:54:09 user nova-compute[74441]:   <name>instance-00000014</name>
Nov 09 00:54:09 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:54:09 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:54:09 user nova-compute[74441]:   <metadata>
Nov 09 00:54:09 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:54:09 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:54:09 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherB-server-1638891823</nova:name>
Nov 09 00:54:09 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:54:08</nova:creationTime>
Nov 09 00:54:09 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:54:09 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:54:09 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:54:09 user nova-compute[74441]:       <nova:owner>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:user uuid="fc13355f609c4b089a91c8e4cd68987a">tempest-ServerActionsTestOtherB-965415346-project-member</nova:user>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:project uuid="491dac50b8ab4e8cadadeae77c480e9a">tempest-ServerActionsTestOtherB-965415346</nova:project>
Nov 09 00:54:09 user nova-compute[74441]:       </nova:owner>
Nov 09 00:54:09 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:54:09 user nova-compute[74441]:       <nova:ports>
Nov 09 00:54:09 user nova-compute[74441]:         <nova:port uuid="22bdea8e-3969-48d2-bdc9-6e80f00a6542">
Nov 09 00:54:09 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 00:54:09 user nova-compute[74441]:         </nova:port>
Nov 09 00:54:09 user nova-compute[74441]:       </nova:ports>
Nov 09 00:54:09 user nova-compute[74441]:     </nova:instance>
Nov 09 00:54:09 user nova-compute[74441]:   </metadata>
Nov 09 00:54:09 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:54:09 user nova-compute[74441]:     <system>
Nov 09 00:54:09 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:54:09 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:54:09 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:54:09 user nova-compute[74441]:       <entry name="serial">670d138e-9fe7-40cc-810f-f88587f03bd8</entry>
Nov 09 00:54:09 user nova-compute[74441]:       <entry name="uuid">670d138e-9fe7-40cc-810f-f88587f03bd8</entry>
Nov 09 00:54:09 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:54:09 user nova-compute[74441]:     </system>
Nov 09 00:54:09 user nova-compute[74441]:   </sysinfo>
Nov 09 00:54:09 user nova-compute[74441]:   <os>
Nov 09 00:54:09 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:54:09 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:54:09 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:54:09 user nova-compute[74441]:   </os>
Nov 09 00:54:09 user nova-compute[74441]:   <features>
Nov 09 00:54:09 user nova-compute[74441]:     <acpi/>
Nov 09 00:54:09 user nova-compute[74441]:     <apic/>
Nov 09 00:54:09 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:54:09 user nova-compute[74441]:   </features>
Nov 09 00:54:09 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:54:09 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:54:09 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:54:09 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:54:09 user nova-compute[74441]:   </clock>
Nov 09 00:54:09 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:54:09 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:54:09 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:54:09 user nova-compute[74441]:   </cpu>
Nov 09 00:54:09 user nova-compute[74441]:   <devices>
Nov 09 00:54:09 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:54:09 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:54:09 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk"/>
Nov 09 00:54:09 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:54:09 user nova-compute[74441]:     </disk>
Nov 09 00:54:09 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:54:09 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:54:09 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 00:54:09 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:54:09 user nova-compute[74441]:       <serial>c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1</serial>
Nov 09 00:54:09 user nova-compute[74441]:     </disk>
Nov 09 00:54:09 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:54:09 user nova-compute[74441]:       <mac address="fa:16:3e:47:b1:f9"/>
Nov 09 00:54:09 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:54:09 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:54:09 user nova-compute[74441]:       <target dev="tap22bdea8e-39"/>
Nov 09 00:54:09 user nova-compute[74441]:     </interface>
Nov 09 00:54:09 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:54:09 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/console.log" append="off"/>
Nov 09 00:54:09 user nova-compute[74441]:     </serial>
Nov 09 00:54:09 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:54:09 user nova-compute[74441]:     <video>
Nov 09 00:54:09 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:54:09 user nova-compute[74441]:     </video>
Nov 09 00:54:09 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:54:09 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:54:09 user nova-compute[74441]:     </rng>
Nov 09 00:54:09 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:54:09 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:54:09 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:54:09 user nova-compute[74441]:     </memballoon>
Nov 09 00:54:09 user nova-compute[74441]:   </devices>
Nov 09 00:54:09 user nova-compute[74441]: </domain>
Nov 09 00:54:09 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:53:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG os_vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d6ed055-dc89-5da8-8cda-79e0bd76cbd7', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22bdea8e-39, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22bdea8e-39, col_values=(('qos', UUID('e61e28b9-9cf8-4615-97a1-69cc89815baf')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22bdea8e-39, col_values=(('external_ids', {'iface-id': '22bdea8e-3969-48d2-bdc9-6e80f00a6542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:b1:f9', 'vm-uuid': '670d138e-9fe7-40cc-810f-f88587f03bd8'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:09 user nova-compute[74441]: INFO os_vif [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39')
Nov 09 00:54:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-fabe61ba-3029-445c-bfd9-c3c47aafe9ef req-ff901982-e10d-40de-b501-51251cc03ca3 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fabe61ba-3029-445c-bfd9-c3c47aafe9ef req-ff901982-e10d-40de-b501-51251cc03ca3 service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fabe61ba-3029-445c-bfd9-c3c47aafe9ef req-ff901982-e10d-40de-b501-51251cc03ca3 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fabe61ba-3029-445c-bfd9-c3c47aafe9ef req-ff901982-e10d-40de-b501-51251cc03ca3 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-fabe61ba-3029-445c-bfd9-c3c47aafe9ef req-ff901982-e10d-40de-b501-51251cc03ca3 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:54:11 user nova-compute[74441]: WARNING nova.compute.manager [req-fabe61ba-3029-445c-bfd9-c3c47aafe9ef req-ff901982-e10d-40de-b501-51251cc03ca3 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state resized and task_state resize_reverting.
Nov 09 00:54:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "378ca4d6-d23b-48f1-af42-c31978672971" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.compute.manager [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Terminating instance
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:54:13 user nova-compute[74441]: WARNING nova.compute.manager [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state resized and task_state resize_reverting.
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-vif-unplugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] No waiting events found dispatching network-vif-unplugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-d29cc73c-d52e-4c7e-bf44-0b84275948f6 req-fddf2bf8-31e5-4dbf-b758-a785027f18bf service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-vif-unplugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance running successfully.
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] finish_revert_migration finished successfully. {{(pid=74441) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Instance destroyed successfully.
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lazy-loading 'resources' on Instance uuid 378ca4d6-d23b-48f1-af42-c31978672971 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1357908257',display_name='tempest-ServersNegativeTestJSON-server-1357908257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1357908257',id=15,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:44:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1fcc87a3fe1470cbae7846b8020ff0e',ramdisk_id='',reservation_id='r-9ms49jfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-296355111',owner_user_name='tempest-ServersNegativeTestJSON-296355111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:44:58Z,user_data=None,user_id='d8e5ce70bd2b4a01934c18f8e12d89f0',uuid=378ca4d6-d23b-48f1-af42-c31978672971,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converting VIF {"id": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "address": "fa:16:3e:0b:ab:6e", "network": {"id": "bfe05201-570b-4271-9e01-622d21ac1852", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1660854668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1fcc87a3fe1470cbae7846b8020ff0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e977767-fc", "ovs_interfaceid": "2e977767-fc3b-4b97-8b3a-d58ea58a429a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG os_vif [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e977767-fc, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e52db126-2f85-483e-b58f-6d2a1378d8e4) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:13 user nova-compute[74441]: INFO os_vif [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:ab:6e,bridge_name='br-int',has_traffic_filtering=True,id=2e977767-fc3b-4b97-8b3a-d58ea58a429a,network=Network(bfe05201-570b-4271-9e01-622d21ac1852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e977767-fc')
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Deleting instance files /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971_del
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Deletion of /opt/stack/data/nova/instances/378ca4d6-d23b-48f1-af42-c31978672971_del complete
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.compute.manager [None req-a431da28-bb57-4bf7-95e6-167882d349e2 tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance to original state: 'active'
Nov 09 00:54:13 user nova-compute[74441]: INFO nova.compute.manager [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 09 00:54:13 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:54:13 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:54:14 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:54:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-34f52f3d-536d-4faf-aee4-c13294e1768b req-44e9b296-cf77-42ae-b804-9ad7a7555101 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-vif-deleted-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:14 user nova-compute[74441]: INFO nova.compute.manager [req-34f52f3d-536d-4faf-aee4-c13294e1768b req-44e9b296-cf77-42ae-b804-9ad7a7555101 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Neutron deleted interface 2e977767-fc3b-4b97-8b3a-d58ea58a429a; detaching it from the instance and deleting it from the info cache
Nov 09 00:54:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-34f52f3d-536d-4faf-aee4-c13294e1768b req-44e9b296-cf77-42ae-b804-9ad7a7555101 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:54:14 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Took 0.78 seconds to deallocate network for instance.
Nov 09 00:54:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-34f52f3d-536d-4faf-aee4-c13294e1768b req-44e9b296-cf77-42ae-b804-9ad7a7555101 service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Detach interface failed, port_id=2e977767-fc3b-4b97-8b3a-d58ea58a429a, reason: Instance 378ca4d6-d23b-48f1-af42-c31978672971 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 00:54:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:15 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Deleted allocations for instance 378ca4d6-d23b-48f1-af42-c31978672971
Nov 09 00:54:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a3c7a62d-0aed-4fc8-bae1-28417072c1de tempest-ServersNegativeTestJSON-296355111 tempest-ServersNegativeTestJSON-296355111-project-member] Lock "378ca4d6-d23b-48f1-af42-c31978672971" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.118s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-960bfa44-f13e-4141-a7ed-503ba8f53fd6 req-747c1028-118c-448a-9a5a-23963d5e619e service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received event network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-960bfa44-f13e-4141-a7ed-503ba8f53fd6 req-747c1028-118c-448a-9a5a-23963d5e619e service nova] Acquiring lock "378ca4d6-d23b-48f1-af42-c31978672971-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-960bfa44-f13e-4141-a7ed-503ba8f53fd6 req-747c1028-118c-448a-9a5a-23963d5e619e service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-960bfa44-f13e-4141-a7ed-503ba8f53fd6 req-747c1028-118c-448a-9a5a-23963d5e619e service nova] Lock "378ca4d6-d23b-48f1-af42-c31978672971-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-960bfa44-f13e-4141-a7ed-503ba8f53fd6 req-747c1028-118c-448a-9a5a-23963d5e619e service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] No waiting events found dispatching network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:54:15 user nova-compute[74441]: WARNING nova.compute.manager [req-960bfa44-f13e-4141-a7ed-503ba8f53fd6 req-747c1028-118c-448a-9a5a-23963d5e619e service nova] [instance: 378ca4d6-d23b-48f1-af42-c31978672971] Received unexpected event network-vif-plugged-2e977767-fc3b-4b97-8b3a-d58ea58a429a for instance with vm_state deleted and task_state None.
Nov 09 00:54:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 499d7158-9ed0-44e3-ba68-96ba7574f469 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "e376efb6-383e-489f-8c1f-13628b496528" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "e376efb6-383e-489f-8c1f-13628b496528" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:54:53 user nova-compute[74441]: INFO nova.compute.claims [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Claim successful on node user
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.network.neutron [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:54:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:54:53 user nova-compute[74441]: DEBUG nova.policy [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '383f477236d64d908d2a2868166d4107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b21e08a84834a8eb02dc374bb92b647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:54:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Creating image(s)
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk 1073741824" returned: 0 in 0.051s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.network.neutron [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Successfully created port: 60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Cannot resize image /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Ensure instance console log exists: /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Successfully updated port: 60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing instance network info cache due to event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance network_info: |[{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.neutron [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Start _get_guest_xml network_info=[{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:54:55 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:54:55 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-554245283',display_name='tempest-ServerRescueNegativeTestJSON-server-554245283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-554245283',id=26,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQqlUfG8BrsdzHhNOWOVwvqa5jDWP2pkMx0+n1NOnQXjDTqRMFh3EUPB0E8JrozViUG83Y17NN8/ojBacrvRZuUmy2R1C7ZIafZmhBhB1aKMv3H2HoYLV8TkfpWuKdqhw==',key_name='tempest-keypair-957892293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-umenp4ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='383f477236d64d908d2a2868166d4107',uuid=7563d22d-e7a8-44fe-b7ac-580dca7ee84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'pci_devices' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:54:55 user nova-compute[74441]:   <uuid>7563d22d-e7a8-44fe-b7ac-580dca7ee84f</uuid>
Nov 09 00:54:55 user nova-compute[74441]:   <name>instance-0000001a</name>
Nov 09 00:54:55 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:54:55 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:54:55 user nova-compute[74441]:   <metadata>
Nov 09 00:54:55 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:54:55 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:54:55 user nova-compute[74441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-554245283</nova:name>
Nov 09 00:54:55 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:54:55</nova:creationTime>
Nov 09 00:54:55 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:54:55 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:54:55 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:54:55 user nova-compute[74441]:       <nova:owner>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:user uuid="383f477236d64d908d2a2868166d4107">tempest-ServerRescueNegativeTestJSON-1883004734-project-member</nova:user>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:project uuid="0b21e08a84834a8eb02dc374bb92b647">tempest-ServerRescueNegativeTestJSON-1883004734</nova:project>
Nov 09 00:54:55 user nova-compute[74441]:       </nova:owner>
Nov 09 00:54:55 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:54:55 user nova-compute[74441]:       <nova:ports>
Nov 09 00:54:55 user nova-compute[74441]:         <nova:port uuid="60f43fd6-011f-4bcc-b3b4-c44eef2851fa">
Nov 09 00:54:55 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 00:54:55 user nova-compute[74441]:         </nova:port>
Nov 09 00:54:55 user nova-compute[74441]:       </nova:ports>
Nov 09 00:54:55 user nova-compute[74441]:     </nova:instance>
Nov 09 00:54:55 user nova-compute[74441]:   </metadata>
Nov 09 00:54:55 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:54:55 user nova-compute[74441]:     <system>
Nov 09 00:54:55 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:54:55 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:54:55 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:54:55 user nova-compute[74441]:       <entry name="serial">7563d22d-e7a8-44fe-b7ac-580dca7ee84f</entry>
Nov 09 00:54:55 user nova-compute[74441]:       <entry name="uuid">7563d22d-e7a8-44fe-b7ac-580dca7ee84f</entry>
Nov 09 00:54:55 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:54:55 user nova-compute[74441]:     </system>
Nov 09 00:54:55 user nova-compute[74441]:   </sysinfo>
Nov 09 00:54:55 user nova-compute[74441]:   <os>
Nov 09 00:54:55 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:54:55 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:54:55 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:54:55 user nova-compute[74441]:   </os>
Nov 09 00:54:55 user nova-compute[74441]:   <features>
Nov 09 00:54:55 user nova-compute[74441]:     <acpi/>
Nov 09 00:54:55 user nova-compute[74441]:     <apic/>
Nov 09 00:54:55 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:54:55 user nova-compute[74441]:   </features>
Nov 09 00:54:55 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:54:55 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:54:55 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:54:55 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:54:55 user nova-compute[74441]:   </clock>
Nov 09 00:54:55 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:54:55 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:54:55 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:54:55 user nova-compute[74441]:   </cpu>
Nov 09 00:54:55 user nova-compute[74441]:   <devices>
Nov 09 00:54:55 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:54:55 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:54:55 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk"/>
Nov 09 00:54:55 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:54:55 user nova-compute[74441]:     </disk>
Nov 09 00:54:55 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:54:55 user nova-compute[74441]:       <mac address="fa:16:3e:a3:32:4a"/>
Nov 09 00:54:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:54:55 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:54:55 user nova-compute[74441]:       <target dev="tap60f43fd6-01"/>
Nov 09 00:54:55 user nova-compute[74441]:     </interface>
Nov 09 00:54:55 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:54:55 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/console.log" append="off"/>
Nov 09 00:54:55 user nova-compute[74441]:     </serial>
Nov 09 00:54:55 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:54:55 user nova-compute[74441]:     <video>
Nov 09 00:54:55 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:54:55 user nova-compute[74441]:     </video>
Nov 09 00:54:55 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:54:55 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:54:55 user nova-compute[74441]:     </rng>
Nov 09 00:54:55 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:54:55 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:54:55 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:54:55 user nova-compute[74441]:     </memballoon>
Nov 09 00:54:55 user nova-compute[74441]:   </devices>
Nov 09 00:54:55 user nova-compute[74441]: </domain>
Nov 09 00:54:55 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-554245283',display_name='tempest-ServerRescueNegativeTestJSON-server-554245283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-554245283',id=26,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQqlUfG8BrsdzHhNOWOVwvqa5jDWP2pkMx0+n1NOnQXjDTqRMFh3EUPB0E8JrozViUG83Y17NN8/ojBacrvRZuUmy2R1C7ZIafZmhBhB1aKMv3H2HoYLV8TkfpWuKdqhw==',key_name='tempest-keypair-957892293',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-umenp4ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='383f477236d64d908d2a2868166d4107',uuid=7563d22d-e7a8-44fe-b7ac-580dca7ee84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG os_vif [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9afd7b50-402b-5cbe-86e3-a0b6a50c4dba', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f43fd6-01, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60f43fd6-01, col_values=(('qos', UUID('a49213dd-06b0-4e8c-be03-69c96186833c')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60f43fd6-01, col_values=(('external_ids', {'iface-id': '60f43fd6-011f-4bcc-b3b4-c44eef2851fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:32:4a', 'vm-uuid': '7563d22d-e7a8-44fe-b7ac-580dca7ee84f'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:55 user nova-compute[74441]: INFO os_vif [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01')
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:54:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:a3:32:4a, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:54:56 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updated VIF entry in instance network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:54:56 user nova-compute[74441]: DEBUG nova.network.neutron [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:54:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6c4604c6-540c-4fd0-94d7-e356c77b25b4 req-f6ac1d4a-bc37-477b-898d-7abc14190c8e service nova] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-cac39b12-96a9-409e-b355-877d00c430b2 req-37d544e3-77b2-49fb-b157-24bb143fed8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cac39b12-96a9-409e-b355-877d00c430b2 req-37d544e3-77b2-49fb-b157-24bb143fed8e service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cac39b12-96a9-409e-b355-877d00c430b2 req-37d544e3-77b2-49fb-b157-24bb143fed8e service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cac39b12-96a9-409e-b355-877d00c430b2 req-37d544e3-77b2-49fb-b157-24bb143fed8e service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-cac39b12-96a9-409e-b355-877d00c430b2 req-37d544e3-77b2-49fb-b157-24bb143fed8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:54:57 user nova-compute[74441]: WARNING nova.compute.manager [req-cac39b12-96a9-409e-b355-877d00c430b2 req-37d544e3-77b2-49fb-b157-24bb143fed8e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state building and task_state spawning.
Nov 09 00:54:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:54:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:54:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:58 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:54:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance spawned successfully.
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:54:59 user nova-compute[74441]: INFO nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-a7b75e29-6081-44c1-b49e-12622fe7021e req-5ebda3cd-4d33-439f-9a23-e62948651c6e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7b75e29-6081-44c1-b49e-12622fe7021e req-5ebda3cd-4d33-439f-9a23-e62948651c6e service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7b75e29-6081-44c1-b49e-12622fe7021e req-5ebda3cd-4d33-439f-9a23-e62948651c6e service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7b75e29-6081-44c1-b49e-12622fe7021e req-5ebda3cd-4d33-439f-9a23-e62948651c6e service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-a7b75e29-6081-44c1-b49e-12622fe7021e req-5ebda3cd-4d33-439f-9a23-e62948651c6e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:54:59 user nova-compute[74441]: WARNING nova.compute.manager [req-a7b75e29-6081-44c1-b49e-12622fe7021e req-5ebda3cd-4d33-439f-9a23-e62948651c6e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state building and task_state spawning.
Nov 09 00:54:59 user nova-compute[74441]: INFO nova.compute.manager [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Took 6.54 seconds to build instance.
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-825d30a5-4ee7-4494-8e8b-d06801038913 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.634s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:54:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:55:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:03 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:55:03 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7882MB free_disk=25.109378814697266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:55:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:55:04 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:55:04 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:55:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:55:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:55:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:07 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:55:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:55:16 user nova-compute[74441]: INFO nova.compute.claims [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Claim successful on node user
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:55:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.policy [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '156577f25fe04e6e8ac3612c2a0dbc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e49bf75726243749bace44e94c1397b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:55:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Creating image(s)
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "/opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk 1073741824" returned: 0 in 0.059s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Successfully created port: d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Cannot resize image /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Ensure instance console log exists: /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Successfully updated port: d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquired lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-changed-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Refreshing instance network info cache due to event network-changed-d717870f-6154-4cd5-997c-59d531b34884. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] Acquiring lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:55:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updating instance_info_cache with network_info: [{"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Releasing lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Instance network_info: |[{"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] Acquired lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Refreshing network info cache for port d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Start _get_guest_xml network_info=[{"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:55:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:55:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1854501932',display_name='tempest-AttachVolumeNegativeTest-server-1854501932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1854501932',id=27,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6HWIPYqi8FMWEBqMDd02PhV1ngIaAMELv5Rgnu24uBfKSkdJ+9ya3paHv/e58LV/Mm7OinuaQEyLvHHQHWtIJJESQ4s+oJT80VrRgCo+8FG4N/9p0RZHASAw7w1mg6Yw==',key_name='tempest-keypair-715302858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-5av3buyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=28c6a03d-4257-41ff-8fdf-7863286b9b03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'pci_devices' on Instance uuid 28c6a03d-4257-41ff-8fdf-7863286b9b03 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:55:19 user nova-compute[74441]:   <uuid>28c6a03d-4257-41ff-8fdf-7863286b9b03</uuid>
Nov 09 00:55:19 user nova-compute[74441]:   <name>instance-0000001b</name>
Nov 09 00:55:19 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:55:19 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:55:19 user nova-compute[74441]:   <metadata>
Nov 09 00:55:19 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:55:19 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:55:19 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1854501932</nova:name>
Nov 09 00:55:19 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:55:19</nova:creationTime>
Nov 09 00:55:19 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:55:19 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:55:19 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:55:19 user nova-compute[74441]:       <nova:owner>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:user uuid="156577f25fe04e6e8ac3612c2a0dbc4d">tempest-AttachVolumeNegativeTest-595140925-project-member</nova:user>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:project uuid="8e49bf75726243749bace44e94c1397b">tempest-AttachVolumeNegativeTest-595140925</nova:project>
Nov 09 00:55:19 user nova-compute[74441]:       </nova:owner>
Nov 09 00:55:19 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:55:19 user nova-compute[74441]:       <nova:ports>
Nov 09 00:55:19 user nova-compute[74441]:         <nova:port uuid="d717870f-6154-4cd5-997c-59d531b34884">
Nov 09 00:55:19 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 00:55:19 user nova-compute[74441]:         </nova:port>
Nov 09 00:55:19 user nova-compute[74441]:       </nova:ports>
Nov 09 00:55:19 user nova-compute[74441]:     </nova:instance>
Nov 09 00:55:19 user nova-compute[74441]:   </metadata>
Nov 09 00:55:19 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:55:19 user nova-compute[74441]:     <system>
Nov 09 00:55:19 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:55:19 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:55:19 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:55:19 user nova-compute[74441]:       <entry name="serial">28c6a03d-4257-41ff-8fdf-7863286b9b03</entry>
Nov 09 00:55:19 user nova-compute[74441]:       <entry name="uuid">28c6a03d-4257-41ff-8fdf-7863286b9b03</entry>
Nov 09 00:55:19 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:55:19 user nova-compute[74441]:     </system>
Nov 09 00:55:19 user nova-compute[74441]:   </sysinfo>
Nov 09 00:55:19 user nova-compute[74441]:   <os>
Nov 09 00:55:19 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:55:19 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:55:19 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:55:19 user nova-compute[74441]:   </os>
Nov 09 00:55:19 user nova-compute[74441]:   <features>
Nov 09 00:55:19 user nova-compute[74441]:     <acpi/>
Nov 09 00:55:19 user nova-compute[74441]:     <apic/>
Nov 09 00:55:19 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:55:19 user nova-compute[74441]:   </features>
Nov 09 00:55:19 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:55:19 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:55:19 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:55:19 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:55:19 user nova-compute[74441]:   </clock>
Nov 09 00:55:19 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:55:19 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:55:19 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:55:19 user nova-compute[74441]:   </cpu>
Nov 09 00:55:19 user nova-compute[74441]:   <devices>
Nov 09 00:55:19 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:55:19 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:55:19 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk"/>
Nov 09 00:55:19 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:55:19 user nova-compute[74441]:     </disk>
Nov 09 00:55:19 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:55:19 user nova-compute[74441]:       <mac address="fa:16:3e:31:bd:c8"/>
Nov 09 00:55:19 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:55:19 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:55:19 user nova-compute[74441]:       <target dev="tapd717870f-61"/>
Nov 09 00:55:19 user nova-compute[74441]:     </interface>
Nov 09 00:55:19 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:55:19 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/console.log" append="off"/>
Nov 09 00:55:19 user nova-compute[74441]:     </serial>
Nov 09 00:55:19 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:55:19 user nova-compute[74441]:     <video>
Nov 09 00:55:19 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:55:19 user nova-compute[74441]:     </video>
Nov 09 00:55:19 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:55:19 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:55:19 user nova-compute[74441]:     </rng>
Nov 09 00:55:19 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:55:19 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:55:19 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:55:19 user nova-compute[74441]:     </memballoon>
Nov 09 00:55:19 user nova-compute[74441]:   </devices>
Nov 09 00:55:19 user nova-compute[74441]: </domain>
Nov 09 00:55:19 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1854501932',display_name='tempest-AttachVolumeNegativeTest-server-1854501932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1854501932',id=27,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6HWIPYqi8FMWEBqMDd02PhV1ngIaAMELv5Rgnu24uBfKSkdJ+9ya3paHv/e58LV/Mm7OinuaQEyLvHHQHWtIJJESQ4s+oJT80VrRgCo+8FG4N/9p0RZHASAw7w1mg6Yw==',key_name='tempest-keypair-715302858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-5av3buyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=28c6a03d-4257-41ff-8fdf-7863286b9b03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG os_vif [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df5f32c0-6978-52ba-8ae3-8714792bd955', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd717870f-61, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd717870f-61, col_values=(('qos', UUID('3c9a74b3-5db7-4291-86a2-c350d5080ff2')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd717870f-61, col_values=(('external_ids', {'iface-id': 'd717870f-6154-4cd5-997c-59d531b34884', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:bd:c8', 'vm-uuid': '28c6a03d-4257-41ff-8fdf-7863286b9b03'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:19 user nova-compute[74441]: INFO os_vif [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61')
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:31:bd:c8, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updated VIF entry in instance network info cache for port d717870f-6154-4cd5-997c-59d531b34884. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updating instance_info_cache with network_info: [{"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:55:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-68bc584f-9d91-408f-91b9-c63a7e3df5fc req-bfee7ddd-729b-4d4e-8a3a-c1e8166a57a7 service nova] Releasing lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing instance network info cache due to event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updated VIF entry in instance network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:55:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e8ee2452-19c0-4cc8-bccf-5df96bc38b48 req-2f79df72-326d-4760-81a8-787a49bb3ebb service nova] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-3074c960-9228-4d6b-8371-e7d62250a2bf req-1f1ddfc9-d3c4-4c70-ab5c-8484e5e74d9e service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3074c960-9228-4d6b-8371-e7d62250a2bf req-1f1ddfc9-d3c4-4c70-ab5c-8484e5e74d9e service nova] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3074c960-9228-4d6b-8371-e7d62250a2bf req-1f1ddfc9-d3c4-4c70-ab5c-8484e5e74d9e service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3074c960-9228-4d6b-8371-e7d62250a2bf req-1f1ddfc9-d3c4-4c70-ab5c-8484e5e74d9e service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-3074c960-9228-4d6b-8371-e7d62250a2bf req-1f1ddfc9-d3c4-4c70-ab5c-8484e5e74d9e service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] No waiting events found dispatching network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:55:21 user nova-compute[74441]: WARNING nova.compute.manager [req-3074c960-9228-4d6b-8371-e7d62250a2bf req-1f1ddfc9-d3c4-4c70-ab5c-8484e5e74d9e service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received unexpected event network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 for instance with vm_state building and task_state spawning.
Nov 09 00:55:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:21 user nova-compute[74441]: INFO nova.compute.manager [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Detaching volume dabff4cd-a099-4e2c-9673-cc0756573a4f
Nov 09 00:55:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:21 user nova-compute[74441]: INFO nova.virt.block_device [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Attempting to driver detach volume dabff4cd-a099-4e2c-9673-cc0756573a4f from mountpoint /dev/vdb
Nov 09 00:55:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Attempting to detach device vdb from instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:55:21 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:55:21 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 00:55:21 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:55:21 user nova-compute[74441]:   <serial>dabff4cd-a099-4e2c-9673-cc0756573a4f</serial>
Nov 09 00:55:21 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:55:21 user nova-compute[74441]: </disk>
Nov 09 00:55:21 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:55:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully detached device vdb from instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 from the persistent domain config.
Nov 09 00:55:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:55:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:55:21 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:55:21 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 00:55:21 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:55:21 user nova-compute[74441]:   <serial>dabff4cd-a099-4e2c-9673-cc0756573a4f</serial>
Nov 09 00:55:21 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 00:55:21 user nova-compute[74441]: </disk>
Nov 09 00:55:21 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing instance network info cache due to event network-changed-5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] Acquiring lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] Acquired lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Refreshing network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:22 user nova-compute[74441]: INFO nova.compute.manager [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Detaching volume 60b6a51b-67c0-439b-a371-1dfaef66106b
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updated VIF entry in instance network info cache for port 5d82b02e-80cd-4d0e-b448-4283ac227b2e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [{"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-256b847e-a404-47b9-88c7-08e7ff2f389e req-bd46ffbe-4e08-4b0a-bc83-cf545fe3b4fa service nova] Releasing lock "refresh_cache-4e8a84ff-6f80-4580-bd05-8a57bc987c48" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:55:22 user nova-compute[74441]: INFO nova.virt.block_device [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Attempting to driver detach volume 60b6a51b-67c0-439b-a371-1dfaef66106b from mountpoint /dev/vdb
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Attempting to detach device vdb from instance e376efb6-383e-489f-8c1f-13628b496528 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:55:22 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:55:22 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:55:22 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:55:22 user nova-compute[74441]:   <serial>60b6a51b-67c0-439b-a371-1dfaef66106b</serial>
Nov 09 00:55:22 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 00:55:22 user nova-compute[74441]: </disk>
Nov 09 00:55:22 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:55:22 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully detached device vdb from instance e376efb6-383e-489f-8c1f-13628b496528 from the persistent domain config.
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e376efb6-383e-489f-8c1f-13628b496528 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 00:55:22 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:55:22 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:55:22 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:55:22 user nova-compute[74441]:   <serial>60b6a51b-67c0-439b-a371-1dfaef66106b</serial>
Nov 09 00:55:22 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 00:55:22 user nova-compute[74441]: </disk>
Nov 09 00:55:22 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 00:55:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-f19342a8-989c-4c39-8aff-adc3cbf28a3b req-d18e174c-4872-4692-860c-47c9946d2977 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f19342a8-989c-4c39-8aff-adc3cbf28a3b req-d18e174c-4872-4692-860c-47c9946d2977 service nova] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f19342a8-989c-4c39-8aff-adc3cbf28a3b req-d18e174c-4872-4692-860c-47c9946d2977 service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f19342a8-989c-4c39-8aff-adc3cbf28a3b req-d18e174c-4872-4692-860c-47c9946d2977 service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-f19342a8-989c-4c39-8aff-adc3cbf28a3b req-d18e174c-4872-4692-860c-47c9946d2977 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] No waiting events found dispatching network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:55:23 user nova-compute[74441]: WARNING nova.compute.manager [req-f19342a8-989c-4c39-8aff-adc3cbf28a3b req-d18e174c-4872-4692-860c-47c9946d2977 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received unexpected event network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 for instance with vm_state building and task_state spawning.
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:55:23 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Instance spawned successfully.
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:55:23 user nova-compute[74441]: INFO nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 09 00:55:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:55:23 user nova-compute[74441]: INFO nova.compute.manager [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Took 7.08 seconds to build instance.
Nov 09 00:55:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a20f5904-25e4-4eb5-b6ae-c4576de13f45 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.188s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:55:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:42 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 is timed out.
Nov 09 00:55:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully detached device vdb from instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 from the live domain config.
Nov 09 00:55:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwjhfruO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:55:42 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011bd13-5c75-45f0-ba1a-24d9ec4beaa3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:55:42 user nova-compute[74441]: No targets found.
Nov 09 00:55:42 user nova-compute[74441]: iSNS:
Nov 09 00:55:42 user nova-compute[74441]: No targets found.
Nov 09 00:55:42 user nova-compute[74441]: STATIC:
Nov 09 00:55:42 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1
Nov 09 00:55:42 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:55:42 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:55:42 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b
Nov 09 00:55:42 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:55:42 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:55:42 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f
Nov 09 00:55:42 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:55:42 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:55:42 user nova-compute[74441]: FIRMWARE:
Nov 09 00:55:42 user nova-compute[74441]: No targets found.
Nov 09 00:55:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:55:42 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:55:42 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87dc542-3f3e-4ad1-904f-e3a5fbbe17ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ef279-f3e2-4b5d-aa3b-28f417ec94d7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:55:42 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:55:42 user nova-compute[74441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:55:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:55:42 user nova-compute[74441]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f (non-flash)
Nov 09 00:55:42 user nova-compute[74441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:55:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c2cb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff598ed-a39e-40fd-8ccb-46336dae54e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ff9ae-5a15-46a7-a3e0-629183b3a87f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06e17ac-0ae9-4a8f-afe3-fb6325f30055]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d397a756-925d-426a-b354-969a34c3ac42]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d323b1-aab3-4915-88cc-90bd5a7e381c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[798fb62c-e9a6-435c-9c8e-0df3b27c2b90]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260]
Nov 09 00:55:42 user nova-compute[74441]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f, portal: 172.16.0.220,3260] successful.
Nov 09 00:55:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dabff4cd-a099-4e2c-9673-cc0756573a4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f50b91-044b-4208-a31a-4d48f074a347]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] <== disconnect_volume: return (322ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:55:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.compute.manager [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing instance network info cache due to event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.network.neutron [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:55:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e376efb6-383e-489f-8c1f-13628b496528 is timed out.
Nov 09 00:55:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully detached device vdb from instance e376efb6-383e-489f-8c1f-13628b496528 from the live domain config.
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nAefFJQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:55:43 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c5c2a-c76f-42b3-878c-98e8d2a57206]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:55:43 user nova-compute[74441]: No targets found.
Nov 09 00:55:43 user nova-compute[74441]: iSNS:
Nov 09 00:55:43 user nova-compute[74441]: No targets found.
Nov 09 00:55:43 user nova-compute[74441]: STATIC:
Nov 09 00:55:43 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1
Nov 09 00:55:43 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:55:43 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:55:43 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b
Nov 09 00:55:43 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:55:43 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:55:43 user nova-compute[74441]: FIRMWARE:
Nov 09 00:55:43 user nova-compute[74441]: No targets found.
Nov 09 00:55:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:55:43 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:55:43 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'flavor' on Instance uuid 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f60082e-6c6e-4c22-bccc-2d33dde9175c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab57db-2c34-498a-b0be-3d332a25314b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:55:43 user nova-compute[74441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:55:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b (non-flash)
Nov 09 00:55:43 user nova-compute[74441]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:55:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c43f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f572fb2d-7874-4fc9-bacc-9dc3376a3b5b tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.126s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5109616-cac9-4d26-a6f4-d33cc2f8b408]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e056ce1a-4b62-4343-9841-fb5b7c6eefe9]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00003387-c247-4ee0-ba6e-995f40c554d0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0310d4f9-8dc3-4d69-8e10-1da94f3ca801]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[944bdb2c-e0e7-4cce-a3c5-c6835f3bd655]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e1bbf-b41a-45fb-bbef-fad9f077bfef]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260]
Nov 09 00:55:43 user nova-compute[74441]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b, portal: 172.16.0.220,3260] successful.
Nov 09 00:55:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60b6a51b-67c0-439b-a371-1dfaef66106b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513a289-b6d8-4f90-b2f2-e74d7fc4d6da]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== disconnect_volume: return (349ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.network.neutron [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updated VIF entry in instance network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG nova.network.neutron [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:55:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5eed4b20-5e24-4ed6-8477-845e70d191d7 req-6cae7967-cff5-4981-a4b2-959bc969df6c service nova] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:55:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:55:44 user nova-compute[74441]: INFO nova.compute.manager [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] instance snapshotting
Nov 09 00:55:44 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Beginning live snapshot process
Nov 09 00:55:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:44 user nova-compute[74441]: DEBUG nova.objects.instance [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'flavor' on Instance uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-212dca2a-8b62-452c-9553-bb08b95e0ac7 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.178s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsutfm6kv/92fb19d7df7b4b96ac46e19590c4a12a.delta 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsutfm6kv/92fb19d7df7b4b96ac46e19590c4a12a.delta 1073741824" returned: 0 in 0.052s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 00:55:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 00:55:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 00:55:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 00:55:46 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:55:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsutfm6kv/92fb19d7df7b4b96ac46e19590c4a12a.delta /opt/stack/data/nova/instances/snapshots/tmpsutfm6kv/92fb19d7df7b4b96ac46e19590c4a12a {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:55:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsutfm6kv/92fb19d7df7b4b96ac46e19590c4a12a.delta /opt/stack/data/nova/instances/snapshots/tmpsutfm6kv/92fb19d7df7b4b96ac46e19590c4a12a" returned: 0 in 0.460s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:55:47 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Snapshot extracted, beginning image upload
Nov 09 00:55:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Snapshot image upload complete
Nov 09 00:55:50 user nova-compute[74441]: INFO nova.compute.manager [None req-eda54d45-3fef-4bef-9046-0986bca85a42 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Took 5.61 seconds to snapshot the instance on the hypervisor.
Nov 09 00:55:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 499d7158-9ed0-44e3-ba68-96ba7574f469 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:55:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:55:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:59 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:55:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:55:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:04 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:56:04 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7659MB free_disk=24.9921875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance e376efb6-383e-489f-8c1f-13628b496528 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 670d138e-9fe7-40cc-810f-f88587f03bd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:56:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:56:05 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:56:05 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:56:05 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:56:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:13 user nova-compute[74441]: INFO nova.compute.manager [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Terminating instance
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-38a64423-a986-4973-b769-be8bdd3061a0 req-06f8a34a-ff1b-4231-a3bb-734f4e022dd3 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-unplugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-38a64423-a986-4973-b769-be8bdd3061a0 req-06f8a34a-ff1b-4231-a3bb-734f4e022dd3 service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-38a64423-a986-4973-b769-be8bdd3061a0 req-06f8a34a-ff1b-4231-a3bb-734f4e022dd3 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-38a64423-a986-4973-b769-be8bdd3061a0 req-06f8a34a-ff1b-4231-a3bb-734f4e022dd3 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-38a64423-a986-4973-b769-be8bdd3061a0 req-06f8a34a-ff1b-4231-a3bb-734f4e022dd3 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-unplugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-38a64423-a986-4973-b769-be8bdd3061a0 req-06f8a34a-ff1b-4231-a3bb-734f4e022dd3 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-unplugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Instance destroyed successfully.
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.objects.instance [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'resources' on Instance uuid e376efb6-383e-489f-8c1f-13628b496528 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-957887165',display_name='tempest-ServerActionsTestOtherA-server-613888714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-957887165',id=22,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3aiFj6myRk8LIGHu+y5KWZYh6GXAxxLvh2MQwbFHCRku5DTfO8A9kRI39wJav2cva+cH0ZsQWGClt63eKMxn4DJGhOyskYXv/gApv60ZizoZx3563A4DOFdnqBgIXM6A==',key_name='tempest-keypair-1946983635',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:52:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-9jeth6pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=e376efb6-383e-489f-8c1f-13628b496528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "address": "fa:16:3e:33:3a:76", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3761d8f8-ca", "ovs_interfaceid": "3761d8f8-ca06-4ab0-8a0c-fe7561451cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG os_vif [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3761d8f8-ca, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc5536a2-13ce-4db4-8df8-3756473cf7c8) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:13 user nova-compute[74441]: INFO os_vif [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=3761d8f8-ca06-4ab0-8a0c-fe7561451cb9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3761d8f8-ca')
Nov 09 00:56:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Deleting instance files /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528_del
Nov 09 00:56:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Deletion of /opt/stack/data/nova/instances/e376efb6-383e-489f-8c1f-13628b496528_del complete
Nov 09 00:56:14 user nova-compute[74441]: INFO nova.compute.manager [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: e376efb6-383e-489f-8c1f-13628b496528] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:56:14 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: e376efb6-383e-489f-8c1f-13628b496528] Took 0.73 seconds to deallocate network for instance.
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:15 user nova-compute[74441]: INFO nova.compute.manager [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Terminating instance
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:15 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Deleted allocations for instance e376efb6-383e-489f-8c1f-13628b496528
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43f3f799-ca5f-4207-9f0d-8e451d3c2ab3 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "e376efb6-383e-489f-8c1f-13628b496528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-e19c24eb-e83d-4716-bb59-0f9364406f56 req-bf041a9b-3369-45c6-8a33-d3e908927a54 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e19c24eb-e83d-4716-bb59-0f9364406f56 req-bf041a9b-3369-45c6-8a33-d3e908927a54 service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e19c24eb-e83d-4716-bb59-0f9364406f56 req-bf041a9b-3369-45c6-8a33-d3e908927a54 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e19c24eb-e83d-4716-bb59-0f9364406f56 req-bf041a9b-3369-45c6-8a33-d3e908927a54 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-e19c24eb-e83d-4716-bb59-0f9364406f56 req-bf041a9b-3369-45c6-8a33-d3e908927a54 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-e19c24eb-e83d-4716-bb59-0f9364406f56 req-bf041a9b-3369-45c6-8a33-d3e908927a54 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-unplugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] Acquiring lock "e376efb6-383e-489f-8c1f-13628b496528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] Lock "e376efb6-383e-489f-8c1f-13628b496528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] No waiting events found dispatching network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:56:15 user nova-compute[74441]: WARNING nova.compute.manager [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received unexpected event network-vif-plugged-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 for instance with vm_state deleted and task_state None.
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-8cad190a-f741-4239-8522-7bff4fdafcc6 req-d0d3df84-7088-4238-aef6-202255a1c9a9 service nova] [instance: e376efb6-383e-489f-8c1f-13628b496528] Received event network-vif-deleted-3761d8f8-ca06-4ab0-8a0c-fe7561451cb9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Instance destroyed successfully.
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lazy-loading 'resources' on Instance uuid 670d138e-9fe7-40cc-810f-f88587f03bd8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1638891823',display_name='tempest-ServerActionsTestOtherB-server-1638891823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1638891823',id=20,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtSRtx/MtBdp/hc381h/LSIDPc8DWfnSvRaeLE4x5KZFENIfeAwdHG6A4fM6GThZidArZKm/H9Dm8A6sxUq1+dr7FuXz/+Z+YLRGPFWLhnFQEOsxBiiOjwPxE1MCbIWrQ==',key_name='tempest-keypair-1261329344',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491dac50b8ab4e8cadadeae77c480e9a',ramdisk_id='',reservation_id='r-ib4o1arj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-965415346',owner_user_name='tempest-ServerActionsTestOtherB-965415346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:54:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13355f609c4b089a91c8e4cd68987a',uuid=670d138e-9fe7-40cc-810f-f88587f03bd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converting VIF {"id": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "address": "fa:16:3e:47:b1:f9", "network": {"id": "15007317-7074-4a02-afee-7244085ddff4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-431562342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491dac50b8ab4e8cadadeae77c480e9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22bdea8e-39", "ovs_interfaceid": "22bdea8e-3969-48d2-bdc9-6e80f00a6542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_vif [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22bdea8e-39, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e61e28b9-9cf8-4615-97a1-69cc89815baf) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:15 user nova-compute[74441]: INFO os_vif [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b1:f9,bridge_name='br-int',has_traffic_filtering=True,id=22bdea8e-3969-48d2-bdc9-6e80f00a6542,network=Network(15007317-7074-4a02-afee-7244085ddff4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22bdea8e-39')
Nov 09 00:56:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ENZMDPyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:56:15 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e2fcdb-f1f1-4224-b0f9-d1cfb2d8f75b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:56:15 user nova-compute[74441]: No targets found.
Nov 09 00:56:15 user nova-compute[74441]: iSNS:
Nov 09 00:56:15 user nova-compute[74441]: No targets found.
Nov 09 00:56:15 user nova-compute[74441]: STATIC:
Nov 09 00:56:15 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1
Nov 09 00:56:15 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:56:15 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:56:15 user nova-compute[74441]: FIRMWARE:
Nov 09 00:56:15 user nova-compute[74441]: No targets found.
Nov 09 00:56:15 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:56:15 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:56:15 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8183d8-6931-4340-9b47-619c04e162a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd06d89c-2347-4708-b46b-795933cc39f2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:56:15 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 (non-flash)
Nov 09 00:56:15 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f01442abf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0c21a-7826-4210-bfc1-1703f4fdcb59]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16b371-1a30-4138-b151-f99abbc35188]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:56:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc45629-0a9d-4c43-9586-3a3955042de7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42820962-d207-46b4-93dd-8b747981797f]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac0ba08-6ff2-4b99-8377-79fd768e3823]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93a1390-cbca-464f-9583-340e2412effb]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260]
Nov 09 00:56:16 user nova-compute[74441]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1, portal: 172.16.0.220,3260] successful.
Nov 09 00:56:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c83384ec-e0c9-4422-9d9e-0bfd4dfc52b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e856698-acf7-41bf-9b3d-ce579926d355]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] <== disconnect_volume: return (305ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:56:16 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Deleting instance files /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8_del
Nov 09 00:56:16 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Deletion of /opt/stack/data/nova/instances/670d138e-9fe7-40cc-810f-f88587f03bd8_del complete
Nov 09 00:56:16 user nova-compute[74441]: INFO nova.compute.manager [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 09 00:56:16 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:56:16 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:56:16 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Took 0.73 seconds to deallocate network for instance.
Nov 09 00:56:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-560710ba-0e0e-414b-b2d3-7ce1ecb00207 req-0dd44ccf-a6ce-44b3-a3c8-5fa79beab701 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-560710ba-0e0e-414b-b2d3-7ce1ecb00207 req-0dd44ccf-a6ce-44b3-a3c8-5fa79beab701 service nova] Acquiring lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-560710ba-0e0e-414b-b2d3-7ce1ecb00207 req-0dd44ccf-a6ce-44b3-a3c8-5fa79beab701 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-560710ba-0e0e-414b-b2d3-7ce1ecb00207 req-0dd44ccf-a6ce-44b3-a3c8-5fa79beab701 service nova] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-560710ba-0e0e-414b-b2d3-7ce1ecb00207 req-0dd44ccf-a6ce-44b3-a3c8-5fa79beab701 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] No waiting events found dispatching network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:56:17 user nova-compute[74441]: WARNING nova.compute.manager [req-560710ba-0e0e-414b-b2d3-7ce1ecb00207 req-0dd44ccf-a6ce-44b3-a3c8-5fa79beab701 service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received unexpected event network-vif-plugged-22bdea8e-3969-48d2-bdc9-6e80f00a6542 for instance with vm_state active and task_state deleting.
Nov 09 00:56:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-05f09231-8294-4b6b-b7d9-7584a1eef3e7 req-02241327-3945-43cc-8716-ac1d998aba5c service nova] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Received event network-vif-deleted-22bdea8e-3969-48d2-bdc9-6e80f00a6542 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:18 user nova-compute[74441]: INFO nova.compute.manager [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] [instance: 670d138e-9fe7-40cc-810f-f88587f03bd8] Took 1.03 seconds to detach 1 volumes for instance.
Nov 09 00:56:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:18 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:56:18 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:56:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:18 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Deleted allocations for instance 670d138e-9fe7-40cc-810f-f88587f03bd8
Nov 09 00:56:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b23e713-0588-4db9-956d-27aa09f1e67a tempest-ServerActionsTestOtherB-965415346 tempest-ServerActionsTestOtherB-965415346-project-member] Lock "670d138e-9fe7-40cc-810f-f88587f03bd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.584s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:23 user nova-compute[74441]: INFO nova.compute.manager [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Terminating instance
Nov 09 00:56:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-04c54813-4d53-4d5b-b04a-8b6516ed6da7 req-16528acc-4ee6-4ebe-9517-e67b9da1fd08 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-unplugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04c54813-4d53-4d5b-b04a-8b6516ed6da7 req-16528acc-4ee6-4ebe-9517-e67b9da1fd08 service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04c54813-4d53-4d5b-b04a-8b6516ed6da7 req-16528acc-4ee6-4ebe-9517-e67b9da1fd08 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-04c54813-4d53-4d5b-b04a-8b6516ed6da7 req-16528acc-4ee6-4ebe-9517-e67b9da1fd08 service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-04c54813-4d53-4d5b-b04a-8b6516ed6da7 req-16528acc-4ee6-4ebe-9517-e67b9da1fd08 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-unplugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-04c54813-4d53-4d5b-b04a-8b6516ed6da7 req-16528acc-4ee6-4ebe-9517-e67b9da1fd08 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-unplugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:56:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Instance destroyed successfully.
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.objects.instance [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lazy-loading 'resources' on Instance uuid 4e8a84ff-6f80-4580-bd05-8a57bc987c48 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-45659143',display_name='tempest-TestMinimumBasicScenario-server-45659143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-45659143',id=24,image_ref='b8b76416-c059-494a-99f6-b712873e902b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxSQ7OPtEJNNkSSmz83rQcwCl8pOILKD3mQapn5BmVKOE1k5svYW0sU/IvmegqzvE1mtzKpNGBhjxFpS8bZvOgBlbs35bKBSneB/RT9nIvb/UHuvWyNfpR0wH9mpHnoEw==',key_name='tempest-TestMinimumBasicScenario-701061094',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:51:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6403e99121d4daba82abd58c7ecb708',ramdisk_id='',reservation_id='r-wpw1v71a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b8b76416-c059-494a-99f6-b712873e902b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1304250277',owner_user_name='tempest-TestMinimumBasicScenario-1304250277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:53:36Z,user_data=None,user_id='5d2d3eb3c7104c9b8f1fd56fd44b8933',uuid=4e8a84ff-6f80-4580-bd05-8a57bc987c48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converting VIF {"id": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "address": "fa:16:3e:a6:14:cd", "network": {"id": "5fc6efbe-6a53-4415-af0a-88337d577408", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1440900919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6403e99121d4daba82abd58c7ecb708", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d82b02e-80", "ovs_interfaceid": "5d82b02e-80cd-4d0e-b448-4283ac227b2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG os_vif [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d82b02e-80, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed9cc596-ec3c-4cda-9f0a-cab9cbd1f5cb) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:24 user nova-compute[74441]: INFO os_vif [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:14:cd,bridge_name='br-int',has_traffic_filtering=True,id=5d82b02e-80cd-4d0e-b448-4283ac227b2e,network=Network(5fc6efbe-6a53-4415-af0a-88337d577408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d82b02e-80')
Nov 09 00:56:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Deleting instance files /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48_del
Nov 09 00:56:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Deletion of /opt/stack/data/nova/instances/4e8a84ff-6f80-4580-bd05-8a57bc987c48_del complete
Nov 09 00:56:24 user nova-compute[74441]: INFO nova.compute.manager [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 00:56:24 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:56:24 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:56:25 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:56:25 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Took 0.58 seconds to deallocate network for instance.
Nov 09 00:56:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-7a1d83f0-93eb-43be-b992-349073396880 req-43d81598-d985-41fa-8a45-476505dbb4c2 service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-deleted-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:25 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:56:25 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:56:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:25 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Deleted allocations for instance 4e8a84ff-6f80-4580-bd05-8a57bc987c48
Nov 09 00:56:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b3380f7d-60d2-4449-a072-ba965956e964 tempest-TestMinimumBasicScenario-1304250277 tempest-TestMinimumBasicScenario-1304250277-project-member] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-581373e1-7bcf-48b9-b5de-1bf7dcfce26c req-0644d922-cadf-4608-8f40-856ae7ad228c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-581373e1-7bcf-48b9-b5de-1bf7dcfce26c req-0644d922-cadf-4608-8f40-856ae7ad228c service nova] Acquiring lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-581373e1-7bcf-48b9-b5de-1bf7dcfce26c req-0644d922-cadf-4608-8f40-856ae7ad228c service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-581373e1-7bcf-48b9-b5de-1bf7dcfce26c req-0644d922-cadf-4608-8f40-856ae7ad228c service nova] Lock "4e8a84ff-6f80-4580-bd05-8a57bc987c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-581373e1-7bcf-48b9-b5de-1bf7dcfce26c req-0644d922-cadf-4608-8f40-856ae7ad228c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] No waiting events found dispatching network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:56:26 user nova-compute[74441]: WARNING nova.compute.manager [req-581373e1-7bcf-48b9-b5de-1bf7dcfce26c req-0644d922-cadf-4608-8f40-856ae7ad228c service nova] [instance: 4e8a84ff-6f80-4580-bd05-8a57bc987c48] Received unexpected event network-vif-plugged-5d82b02e-80cd-4d0e-b448-4283ac227b2e for instance with vm_state deleted and task_state None.
Nov 09 00:56:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 00:56:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:56:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 00:56:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing instance network info cache due to event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.objects.instance [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'flavor' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:56:44 user nova-compute[74441]: INFO nova.compute.manager [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Attaching volume 487b96df-4f18-4b75-afd4-ffdb14bf7609 to /dev/vdb
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updated VIF entry in instance network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.network.neutron [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-334fe5f4-77fe-4cbc-9d34-c20ea575e33f req-29242df2-6fcc-4d50-930f-4d7a2257f919 service nova] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG os_brick.utils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd4f79-9c51-4aef-a8fe-d53dbe743457]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81792dd-9800-4d4a-b045-4bb887559ca8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f1c88-e31c-4274-bc3c-1aaa79355cd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecfefb5-c721-46d9-a97d-9f3215d50eef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:56:44 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:56:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2bd0f-9a9b-471f-88a0-09bb481270ba]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG os_brick.utils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:56:44 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating existing volume attachment record: 1be6424d-75da-494c-8703-2b4dc0dee5e4 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:56:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:56:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:56:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:59 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:56:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:56:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:02 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:04 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:04 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8140MB free_disk=25.072921752929688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:57:04 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:57:05 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:57:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-changed-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Refreshing instance network info cache due to event network-changed-d717870f-6154-4cd5-997c-59d531b34884. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:57:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] Acquiring lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] Acquired lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Refreshing network info cache for port d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:57:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:08 user nova-compute[74441]: DEBUG nova.network.neutron [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updated VIF entry in instance network info cache for port d717870f-6154-4cd5-997c-59d531b34884. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:57:08 user nova-compute[74441]: DEBUG nova.network.neutron [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updating instance_info_cache with network_info: [{"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-21becbfc-57db-4825-bc93-02f165ab55d2 req-93f8d7ac-a38c-41e4-81dd-1a8b704beb7f service nova] Releasing lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:14 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 28c6a03d-4257-41ff-8fdf-7863286b9b03 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:15 user nova-compute[74441]: INFO nova.compute.manager [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Attaching volume a5632f8f-dae5-4f98-88b4-ae8ef309aee2 to /dev/vdb
Nov 09 00:57:15 user nova-compute[74441]: DEBUG os_brick.utils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a2872c-5344-45bb-90ad-33def5ebe573]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49a4021-691c-491e-86f5-1390ee2cddda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[11267f41-8485-4886-a227-e024648b179f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b966d8a8-61b3-4dd5-abf0-2111dedf5b39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:57:15 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:57:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea994ce-1d77-4f1f-ba56-c62a7492bc46]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG os_brick.utils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updating existing volume attachment record: 776a0304-0779-433d-b78e-21bf3b0c5c8e {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:57:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZqKrchb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:57:26 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:57:26 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:57:26 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9aad5-2158-4b5a-ba4f-315b54f23709]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:57:26 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c549d6-d513-4d65-809b-1efad42bd184]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609] added
Nov 09 00:57:26 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9245df6-27a8-47d9-bbb1-e04923cfc990]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb4c2ef-04e5-4b95-9934-1ffc87dd32c0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZqKrchb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZqKrchb" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a843c21-e40d-418a-99e9-c47e515dd35b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LZqKrchb'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad4a87-5829-442a-94d0-9e5b68cde1a5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021b2af-4d05-455e-beca-1105f7771f1d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:57:26 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 00:57:26 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:57:26 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 00:57:26 user nova-compute[74441]: 
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[553aa5f9-ec84-4273-86df-f4c0658fbab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260]
Nov 09 00:57:26 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260] successful.
Nov 09 00:57:26 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06a2528-5f73-472e-ae99-a7e707599a8b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[37329365-4d97-4bfa-aff7-66174e402137]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:57:26 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:57:26 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69984ee6-90fe-43d6-bef5-b70b107bdf20]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:57:26 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZqKrchb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:57:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:57:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23731313236636465', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:57:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731313236636465', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:57:27 user nova-compute[74441]: DEBUG nova.objects.instance [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'flavor' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:57:27 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:57:27 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 00:57:27 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:57:27 user nova-compute[74441]:   <serial>487b96df-4f18-4b75-afd4-ffdb14bf7609</serial>
Nov 09 00:57:27 user nova-compute[74441]: </disk>
Nov 09 00:57:27 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:57:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:57:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:57:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:a3:32:4a, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:57:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-71b7cda0-cd24-4958-8848-87183ea7a091 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:29 user nova-compute[74441]: INFO nova.compute.manager [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Rescuing
Nov 09 00:57:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:29 user nova-compute[74441]: DEBUG nova.network.neutron [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:57:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:30 user nova-compute[74441]: DEBUG nova.network.neutron [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-60d4d15a-2987-4e43-8ec2-ce00de358786 req-ff140c0c-fd83-47b6-9f25-73d26db4850d service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-60d4d15a-2987-4e43-8ec2-ce00de358786 req-ff140c0c-fd83-47b6-9f25-73d26db4850d service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-60d4d15a-2987-4e43-8ec2-ce00de358786 req-ff140c0c-fd83-47b6-9f25-73d26db4850d service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-60d4d15a-2987-4e43-8ec2-ce00de358786 req-ff140c0c-fd83-47b6-9f25-73d26db4850d service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-60d4d15a-2987-4e43-8ec2-ce00de358786 req-ff140c0c-fd83-47b6-9f25-73d26db4850d service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:31 user nova-compute[74441]: WARNING nova.compute.manager [req-60d4d15a-2987-4e43-8ec2-ce00de358786 req-ff140c0c-fd83-47b6-9f25-73d26db4850d service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state active and task_state rescuing.
Nov 09 00:57:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance destroyed successfully.
Nov 09 00:57:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Attempting rescue
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 00:57:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Creating image(s)
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.241s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue" returned: 0 in 0.065s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'migration_context' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.base [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<7563d22d-e7a8-44fe-b7ac-580dca7ee84f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Start _get_guest_xml network_info=[{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:a3:32:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'resources' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.base [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<7563d22d-e7a8-44fe-b7ac-580dca7ee84f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'numa_topology' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.base [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<7563d22d-e7a8-44fe-b7ac-580dca7ee84f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:57:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.base [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<7563d22d-e7a8-44fe-b7ac-580dca7ee84f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-554245283',display_name='tempest-ServerRescueNegativeTestJSON-server-554245283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-554245283',id=26,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQqlUfG8BrsdzHhNOWOVwvqa5jDWP2pkMx0+n1NOnQXjDTqRMFh3EUPB0E8JrozViUG83Y17NN8/ojBacrvRZuUmy2R1C7ZIafZmhBhB1aKMv3H2HoYLV8TkfpWuKdqhw==',key_name='tempest-keypair-957892293',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:54:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-umenp4ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='383f477236d64d908d2a2868166d4107',uuid=7563d22d-e7a8-44fe-b7ac-580dca7ee84f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:a3:32:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "vif_mac": "fa:16:3e:a3:32:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'pci_devices' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.objects.base [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Object Instance<7563d22d-e7a8-44fe-b7ac-580dca7ee84f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:57:31 user nova-compute[74441]:   <uuid>7563d22d-e7a8-44fe-b7ac-580dca7ee84f</uuid>
Nov 09 00:57:31 user nova-compute[74441]:   <name>instance-0000001a</name>
Nov 09 00:57:31 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:57:31 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:57:31 user nova-compute[74441]:   <metadata>
Nov 09 00:57:31 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:57:31 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:57:31 user nova-compute[74441]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-554245283</nova:name>
Nov 09 00:57:31 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:57:31</nova:creationTime>
Nov 09 00:57:31 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:57:31 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:57:31 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:57:31 user nova-compute[74441]:       <nova:owner>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:user uuid="383f477236d64d908d2a2868166d4107">tempest-ServerRescueNegativeTestJSON-1883004734-project-member</nova:user>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:project uuid="0b21e08a84834a8eb02dc374bb92b647">tempest-ServerRescueNegativeTestJSON-1883004734</nova:project>
Nov 09 00:57:31 user nova-compute[74441]:       </nova:owner>
Nov 09 00:57:31 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:57:31 user nova-compute[74441]:       <nova:ports>
Nov 09 00:57:31 user nova-compute[74441]:         <nova:port uuid="60f43fd6-011f-4bcc-b3b4-c44eef2851fa">
Nov 09 00:57:31 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 00:57:31 user nova-compute[74441]:         </nova:port>
Nov 09 00:57:31 user nova-compute[74441]:       </nova:ports>
Nov 09 00:57:31 user nova-compute[74441]:     </nova:instance>
Nov 09 00:57:31 user nova-compute[74441]:   </metadata>
Nov 09 00:57:31 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:57:31 user nova-compute[74441]:     <system>
Nov 09 00:57:31 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:57:31 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:57:31 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:57:31 user nova-compute[74441]:       <entry name="serial">7563d22d-e7a8-44fe-b7ac-580dca7ee84f</entry>
Nov 09 00:57:31 user nova-compute[74441]:       <entry name="uuid">7563d22d-e7a8-44fe-b7ac-580dca7ee84f</entry>
Nov 09 00:57:31 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:57:31 user nova-compute[74441]:     </system>
Nov 09 00:57:31 user nova-compute[74441]:   </sysinfo>
Nov 09 00:57:31 user nova-compute[74441]:   <os>
Nov 09 00:57:31 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:57:31 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:57:31 user nova-compute[74441]:   </os>
Nov 09 00:57:31 user nova-compute[74441]:   <features>
Nov 09 00:57:31 user nova-compute[74441]:     <acpi/>
Nov 09 00:57:31 user nova-compute[74441]:     <apic/>
Nov 09 00:57:31 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:57:31 user nova-compute[74441]:   </features>
Nov 09 00:57:31 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:57:31 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:57:31 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:57:31 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:57:31 user nova-compute[74441]:   </clock>
Nov 09 00:57:31 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:57:31 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:57:31 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:57:31 user nova-compute[74441]:   </cpu>
Nov 09 00:57:31 user nova-compute[74441]:   <devices>
Nov 09 00:57:31 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:57:31 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:57:31 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue"/>
Nov 09 00:57:31 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:57:31 user nova-compute[74441]:     </disk>
Nov 09 00:57:31 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:57:31 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:57:31 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk"/>
Nov 09 00:57:31 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:57:31 user nova-compute[74441]:     </disk>
Nov 09 00:57:31 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:57:31 user nova-compute[74441]:       <mac address="fa:16:3e:a3:32:4a"/>
Nov 09 00:57:31 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:57:31 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:57:31 user nova-compute[74441]:       <target dev="tap60f43fd6-01"/>
Nov 09 00:57:31 user nova-compute[74441]:     </interface>
Nov 09 00:57:31 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:57:31 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/console.log" append="off"/>
Nov 09 00:57:31 user nova-compute[74441]:     </serial>
Nov 09 00:57:31 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:57:31 user nova-compute[74441]:     <video>
Nov 09 00:57:31 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:57:31 user nova-compute[74441]:     </video>
Nov 09 00:57:31 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:57:31 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:57:31 user nova-compute[74441]:     </rng>
Nov 09 00:57:31 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:57:31 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:57:31 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:57:31 user nova-compute[74441]:     </memballoon>
Nov 09 00:57:31 user nova-compute[74441]:   </devices>
Nov 09 00:57:31 user nova-compute[74441]: </domain>
Nov 09 00:57:31 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:57:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance destroyed successfully.
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:57:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] No VIF found with MAC fa:16:3e:a3:32:4a, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:57:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-512f1ea9-23bd-42ca-90f4-334b10c3970c req-5d356af2-20fc-44f4-9c60-65ae208522c1 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-512f1ea9-23bd-42ca-90f4-334b10c3970c req-5d356af2-20fc-44f4-9c60-65ae208522c1 service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-512f1ea9-23bd-42ca-90f4-334b10c3970c req-5d356af2-20fc-44f4-9c60-65ae208522c1 service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-512f1ea9-23bd-42ca-90f4-334b10c3970c req-5d356af2-20fc-44f4-9c60-65ae208522c1 service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-512f1ea9-23bd-42ca-90f4-334b10c3970c req-5d356af2-20fc-44f4-9c60-65ae208522c1 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:33 user nova-compute[74441]: WARNING nova.compute.manager [req-512f1ea9-23bd-42ca-90f4-334b10c3970c req-5d356af2-20fc-44f4-9c60-65ae208522c1 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state active and task_state rescuing.
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:57:33 user nova-compute[74441]: INFO nova.compute.claims [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Claim successful on node user
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:57:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:57:33 user nova-compute[74441]: DEBUG nova.policy [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffa1084de0be460fa924e3f124e47a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf77bd26a3e4bb1831823704242a3b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:57:34 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Creating image(s)
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "/opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "/opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk 1073741824" returned: 0 in 0.066s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Successfully created port: 32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Cannot resize image /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Ensure instance console log exists: /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Successfully updated port: 32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquired lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-changed-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Refreshing instance network info cache due to event network-changed-32d382fe-7c96-4600-a1bc-34096d65f3c6. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] Acquiring lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-78f969b9-5ea2-49cc-bd09-6f3691b78906 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.neutron [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updating instance_info_cache with network_info: [{"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Releasing lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Instance network_info: |[{"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] Acquired lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Refreshing network info cache for port 32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Start _get_guest_xml network_info=[{"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:57:36 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:36 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-678253497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-678253497',id=28,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-s84tfk2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:57:34Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:57:36 user nova-compute[74441]:   <uuid>3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd</uuid>
Nov 09 00:57:36 user nova-compute[74441]:   <name>instance-0000001c</name>
Nov 09 00:57:36 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:57:36 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:57:36 user nova-compute[74441]:   <metadata>
Nov 09 00:57:36 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:57:36 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:57:36 user nova-compute[74441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-678253497</nova:name>
Nov 09 00:57:36 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:57:36</nova:creationTime>
Nov 09 00:57:36 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:57:36 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:57:36 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:57:36 user nova-compute[74441]:       <nova:owner>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:user uuid="ffa1084de0be460fa924e3f124e47a21">tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member</nova:user>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:project uuid="aaf77bd26a3e4bb1831823704242a3b6">tempest-ServerBootFromVolumeStableRescueTest-1850620491</nova:project>
Nov 09 00:57:36 user nova-compute[74441]:       </nova:owner>
Nov 09 00:57:36 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:57:36 user nova-compute[74441]:       <nova:ports>
Nov 09 00:57:36 user nova-compute[74441]:         <nova:port uuid="32d382fe-7c96-4600-a1bc-34096d65f3c6">
Nov 09 00:57:36 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 00:57:36 user nova-compute[74441]:         </nova:port>
Nov 09 00:57:36 user nova-compute[74441]:       </nova:ports>
Nov 09 00:57:36 user nova-compute[74441]:     </nova:instance>
Nov 09 00:57:36 user nova-compute[74441]:   </metadata>
Nov 09 00:57:36 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:57:36 user nova-compute[74441]:     <system>
Nov 09 00:57:36 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:57:36 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:57:36 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:57:36 user nova-compute[74441]:       <entry name="serial">3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd</entry>
Nov 09 00:57:36 user nova-compute[74441]:       <entry name="uuid">3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd</entry>
Nov 09 00:57:36 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:57:36 user nova-compute[74441]:     </system>
Nov 09 00:57:36 user nova-compute[74441]:   </sysinfo>
Nov 09 00:57:36 user nova-compute[74441]:   <os>
Nov 09 00:57:36 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:57:36 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:57:36 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:57:36 user nova-compute[74441]:   </os>
Nov 09 00:57:36 user nova-compute[74441]:   <features>
Nov 09 00:57:36 user nova-compute[74441]:     <acpi/>
Nov 09 00:57:36 user nova-compute[74441]:     <apic/>
Nov 09 00:57:36 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:57:36 user nova-compute[74441]:   </features>
Nov 09 00:57:36 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:57:36 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:57:36 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:57:36 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:57:36 user nova-compute[74441]:   </clock>
Nov 09 00:57:36 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:57:36 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:57:36 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:57:36 user nova-compute[74441]:   </cpu>
Nov 09 00:57:36 user nova-compute[74441]:   <devices>
Nov 09 00:57:36 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:57:36 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:57:36 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk"/>
Nov 09 00:57:36 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:57:36 user nova-compute[74441]:     </disk>
Nov 09 00:57:36 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:57:36 user nova-compute[74441]:       <mac address="fa:16:3e:7b:34:c4"/>
Nov 09 00:57:36 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:57:36 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:57:36 user nova-compute[74441]:       <target dev="tap32d382fe-7c"/>
Nov 09 00:57:36 user nova-compute[74441]:     </interface>
Nov 09 00:57:36 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:57:36 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/console.log" append="off"/>
Nov 09 00:57:36 user nova-compute[74441]:     </serial>
Nov 09 00:57:36 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:57:36 user nova-compute[74441]:     <video>
Nov 09 00:57:36 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:57:36 user nova-compute[74441]:     </video>
Nov 09 00:57:36 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:57:36 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:57:36 user nova-compute[74441]:     </rng>
Nov 09 00:57:36 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:57:36 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:57:36 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:57:36 user nova-compute[74441]:     </memballoon>
Nov 09 00:57:36 user nova-compute[74441]:   </devices>
Nov 09 00:57:36 user nova-compute[74441]: </domain>
Nov 09 00:57:36 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-678253497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-678253497',id=28,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-s84tfk2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:57:34Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_vif [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b98d3c1-2fb1-556c-b18a-4d0ceaf9b2a4', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.objects.instance [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'flavor' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32d382fe-7c, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32d382fe-7c, col_values=(('qos', UUID('73f19caa-1944-4b10-9a55-25d7be685ffd')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32d382fe-7c, col_values=(('external_ids', {'iface-id': '32d382fe-7c96-4600-a1bc-34096d65f3c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:34:c4', 'vm-uuid': '3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:36 user nova-compute[74441]: INFO os_vif [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c')
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No VIF found with MAC fa:16:3e:7b:34:c4, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:36 user nova-compute[74441]: INFO nova.compute.manager [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Attaching volume fec3dc9a-166b-4b6c-80af-c63ec20058b9 to /dev/vdb
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_brick.utils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updated VIF entry in instance network info cache for port 32d382fe-7c96-4600-a1bc-34096d65f3c6. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updating instance_info_cache with network_info: [{"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47ce9c-3f3f-4028-925b-b3034b44c64c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a65c7c6f-0c03-4ce9-95e9-8a33d80ed27e req-0846fe0d-cac2-4c62-9c53-179104bb5e35 service nova] Releasing lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb5052c-0f83-4b16-8319-69953bda5bb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb3639-44a8-4537-a033-54a29ec45fcc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868db3b-899e-4d10-9c3d-74c5aba6c7db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:57:36 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:57:36 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee3065-9016-4524-b948-e5a034d32c34]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG os_brick.utils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:57:36 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating existing volume attachment record: 87b8a7f2-071f-4146-874f-86e9ce5d2ccc {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-918d4b0f-3ab9-44c9-acd5-7a93e3d555f1 req-fdeb112e-cff4-456a-9400-fc011e65d383 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-918d4b0f-3ab9-44c9-acd5-7a93e3d555f1 req-fdeb112e-cff4-456a-9400-fc011e65d383 service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-918d4b0f-3ab9-44c9-acd5-7a93e3d555f1 req-fdeb112e-cff4-456a-9400-fc011e65d383 service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-918d4b0f-3ab9-44c9-acd5-7a93e3d555f1 req-fdeb112e-cff4-456a-9400-fc011e65d383 service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-918d4b0f-3ab9-44c9-acd5-7a93e3d555f1 req-fdeb112e-cff4-456a-9400-fc011e65d383 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:37 user nova-compute[74441]: WARNING nova.compute.manager [req-918d4b0f-3ab9-44c9-acd5-7a93e3d555f1 req-fdeb112e-cff4-456a-9400-fc011e65d383 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state rescued and task_state None.
Nov 09 00:57:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:39 user nova-compute[74441]: WARNING nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state rescued and task_state None.
Nov 09 00:57:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] No waiting events found dispatching network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:39 user nova-compute[74441]: WARNING nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received unexpected event network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 for instance with vm_state building and task_state spawning.
Nov 09 00:57:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] No waiting events found dispatching network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:39 user nova-compute[74441]: WARNING nova.compute.manager [req-d6f9e7d8-8b5c-4222-b13b-6b2c98cd4741 req-55e46505-cf45-44d6-86a3-c00601b664cf service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received unexpected event network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 for instance with vm_state building and task_state spawning.
Nov 09 00:57:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:57:40 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Instance spawned successfully.
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:40 user nova-compute[74441]: INFO nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 09 00:57:40 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:57:40 user nova-compute[74441]: INFO nova.compute.manager [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Took 7.20 seconds to build instance.
Nov 09 00:57:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c130cda0-36bb-477c-8280-8effd9c6a3ae tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.317s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:57:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:57:45 user nova-compute[74441]: INFO nova.compute.claims [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Claim successful on node user
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:57:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.policy [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dff88b5dff14f34a7c222f369ee6848', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967adbed91e24d0d86706b6884beaacd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:57:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Creating image(s)
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "/opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "/opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.224s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.269s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk 1073741824" returned: 0 in 0.071s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Successfully created port: fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Cannot resize image /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Ensure instance console log exists: /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Successfully updated port: fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquired lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-changed-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Refreshing instance network info cache due to event network-changed-fbce1843-c995-458c-a094-e46838e22a25. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] Acquiring lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating instance_info_cache with network_info: [{"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Releasing lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Instance network_info: |[{"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] Acquired lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Refreshing network info cache for port fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Start _get_guest_xml network_info=[{"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:57:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-400101954',display_name='tempest-SnapshotDataIntegrityTests-server-400101954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-400101954',id=29,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPy+fRBkVlFgLj2C9BtyO3SUIIb9ReccyoNztfolIfbm10XoAtrfLjMQJ4l8z6Z/HJlzhRPipFFBaPNBa36+13gQqbeIsQhxwsdtNBG4N4EGKxZQesLj6nk1LKPKB2vmw==',key_name='tempest-keypair-2012682569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='967adbed91e24d0d86706b6884beaacd',ramdisk_id='',reservation_id='r-w5ohmn04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-874532405',owner_user_name='tempest-SnapshotDataIntegrityTests-874532405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dff88b5dff14f34a7c222f369ee6848',uuid=c9a2a32a-0b08-4a4b-bfd1-c6c88983d312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Converting VIF {"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'pci_devices' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:57:48 user nova-compute[74441]:   <uuid>c9a2a32a-0b08-4a4b-bfd1-c6c88983d312</uuid>
Nov 09 00:57:48 user nova-compute[74441]:   <name>instance-0000001d</name>
Nov 09 00:57:48 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:57:48 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:57:48 user nova-compute[74441]:   <metadata>
Nov 09 00:57:48 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:57:48 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:57:48 user nova-compute[74441]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-400101954</nova:name>
Nov 09 00:57:48 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:57:48</nova:creationTime>
Nov 09 00:57:48 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:57:48 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:57:48 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:57:48 user nova-compute[74441]:       <nova:owner>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:user uuid="9dff88b5dff14f34a7c222f369ee6848">tempest-SnapshotDataIntegrityTests-874532405-project-member</nova:user>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:project uuid="967adbed91e24d0d86706b6884beaacd">tempest-SnapshotDataIntegrityTests-874532405</nova:project>
Nov 09 00:57:48 user nova-compute[74441]:       </nova:owner>
Nov 09 00:57:48 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:57:48 user nova-compute[74441]:       <nova:ports>
Nov 09 00:57:48 user nova-compute[74441]:         <nova:port uuid="fbce1843-c995-458c-a094-e46838e22a25">
Nov 09 00:57:48 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 00:57:48 user nova-compute[74441]:         </nova:port>
Nov 09 00:57:48 user nova-compute[74441]:       </nova:ports>
Nov 09 00:57:48 user nova-compute[74441]:     </nova:instance>
Nov 09 00:57:48 user nova-compute[74441]:   </metadata>
Nov 09 00:57:48 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:57:48 user nova-compute[74441]:     <system>
Nov 09 00:57:48 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:57:48 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:57:48 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:57:48 user nova-compute[74441]:       <entry name="serial">c9a2a32a-0b08-4a4b-bfd1-c6c88983d312</entry>
Nov 09 00:57:48 user nova-compute[74441]:       <entry name="uuid">c9a2a32a-0b08-4a4b-bfd1-c6c88983d312</entry>
Nov 09 00:57:48 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:57:48 user nova-compute[74441]:     </system>
Nov 09 00:57:48 user nova-compute[74441]:   </sysinfo>
Nov 09 00:57:48 user nova-compute[74441]:   <os>
Nov 09 00:57:48 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:57:48 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:57:48 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:57:48 user nova-compute[74441]:   </os>
Nov 09 00:57:48 user nova-compute[74441]:   <features>
Nov 09 00:57:48 user nova-compute[74441]:     <acpi/>
Nov 09 00:57:48 user nova-compute[74441]:     <apic/>
Nov 09 00:57:48 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:57:48 user nova-compute[74441]:   </features>
Nov 09 00:57:48 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:57:48 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:57:48 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:57:48 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:57:48 user nova-compute[74441]:   </clock>
Nov 09 00:57:48 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:57:48 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:57:48 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:57:48 user nova-compute[74441]:   </cpu>
Nov 09 00:57:48 user nova-compute[74441]:   <devices>
Nov 09 00:57:48 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:57:48 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:57:48 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk"/>
Nov 09 00:57:48 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:57:48 user nova-compute[74441]:     </disk>
Nov 09 00:57:48 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:57:48 user nova-compute[74441]:       <mac address="fa:16:3e:45:27:b1"/>
Nov 09 00:57:48 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:57:48 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:57:48 user nova-compute[74441]:       <target dev="tapfbce1843-c9"/>
Nov 09 00:57:48 user nova-compute[74441]:     </interface>
Nov 09 00:57:48 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:57:48 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/console.log" append="off"/>
Nov 09 00:57:48 user nova-compute[74441]:     </serial>
Nov 09 00:57:48 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:57:48 user nova-compute[74441]:     <video>
Nov 09 00:57:48 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:57:48 user nova-compute[74441]:     </video>
Nov 09 00:57:48 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:57:48 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:57:48 user nova-compute[74441]:     </rng>
Nov 09 00:57:48 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:57:48 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:57:48 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:57:48 user nova-compute[74441]:     </memballoon>
Nov 09 00:57:48 user nova-compute[74441]:   </devices>
Nov 09 00:57:48 user nova-compute[74441]: </domain>
Nov 09 00:57:48 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-400101954',display_name='tempest-SnapshotDataIntegrityTests-server-400101954',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-400101954',id=29,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPy+fRBkVlFgLj2C9BtyO3SUIIb9ReccyoNztfolIfbm10XoAtrfLjMQJ4l8z6Z/HJlzhRPipFFBaPNBa36+13gQqbeIsQhxwsdtNBG4N4EGKxZQesLj6nk1LKPKB2vmw==',key_name='tempest-keypair-2012682569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='967adbed91e24d0d86706b6884beaacd',ramdisk_id='',reservation_id='r-w5ohmn04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-874532405',owner_user_name='tempest-SnapshotDataIntegrityTests-874532405-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dff88b5dff14f34a7c222f369ee6848',uuid=c9a2a32a-0b08-4a4b-bfd1-c6c88983d312,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Converting VIF {"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG os_vif [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '232e4546-b209-536c-9ab8-6fd01e9cbd96', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbce1843-c9, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbce1843-c9, col_values=(('qos', UUID('a755461b-9072-4c22-88fb-c0c8de6ec908')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbce1843-c9, col_values=(('external_ids', {'iface-id': 'fbce1843-c995-458c-a094-e46838e22a25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:27:b1', 'vm-uuid': 'c9a2a32a-0b08-4a4b-bfd1-c6c88983d312'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:48 user nova-compute[74441]: INFO os_vif [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9')
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No VIF found with MAC fa:16:3e:45:27:b1, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updated VIF entry in instance network info cache for port fbce1843-c995-458c-a094-e46838e22a25. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating instance_info_cache with network_info: [{"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1b4ac136-b76f-4a33-ae81-ddb7ae926473 req-100004ab-6c7b-45a2-af07-7588e5b7bdb7 service nova] Releasing lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-cc0e168e-d614-4fe0-96d9-842e1ce90e34 req-557f1dae-fc29-4cdb-b7e9-c4da44b8d36c service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cc0e168e-d614-4fe0-96d9-842e1ce90e34 req-557f1dae-fc29-4cdb-b7e9-c4da44b8d36c service nova] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cc0e168e-d614-4fe0-96d9-842e1ce90e34 req-557f1dae-fc29-4cdb-b7e9-c4da44b8d36c service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-cc0e168e-d614-4fe0-96d9-842e1ce90e34 req-557f1dae-fc29-4cdb-b7e9-c4da44b8d36c service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-cc0e168e-d614-4fe0-96d9-842e1ce90e34 req-557f1dae-fc29-4cdb-b7e9-c4da44b8d36c service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] No waiting events found dispatching network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:50 user nova-compute[74441]: WARNING nova.compute.manager [req-cc0e168e-d614-4fe0-96d9-842e1ce90e34 req-557f1dae-fc29-4cdb-b7e9-c4da44b8d36c service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received unexpected event network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 for instance with vm_state building and task_state spawning.
Nov 09 00:57:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-45a082eb-d4f5-4be8-988f-563bfadb8f10 req-98077530-98b9-4aff-a1b0-89e491f72c05 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-45a082eb-d4f5-4be8-988f-563bfadb8f10 req-98077530-98b9-4aff-a1b0-89e491f72c05 service nova] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-45a082eb-d4f5-4be8-988f-563bfadb8f10 req-98077530-98b9-4aff-a1b0-89e491f72c05 service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-45a082eb-d4f5-4be8-988f-563bfadb8f10 req-98077530-98b9-4aff-a1b0-89e491f72c05 service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-45a082eb-d4f5-4be8-988f-563bfadb8f10 req-98077530-98b9-4aff-a1b0-89e491f72c05 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] No waiting events found dispatching network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:57:52 user nova-compute[74441]: WARNING nova.compute.manager [req-45a082eb-d4f5-4be8-988f-563bfadb8f10 req-98077530-98b9-4aff-a1b0-89e491f72c05 service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received unexpected event network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 for instance with vm_state building and task_state spawning.
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:57:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Instance spawned successfully.
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:57:52 user nova-compute[74441]: INFO nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 09 00:57:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:57:52 user nova-compute[74441]: INFO nova.compute.manager [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Took 7.34 seconds to build instance.
Nov 09 00:57:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4f447aee-107e-4a12-91ea-d23c97e28881 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.685s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:57:54 user nova-compute[74441]: INFO nova.compute.claims [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Claim successful on node user
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.network.neutron [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:57:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:57:54 user nova-compute[74441]: INFO nova.virt.block_device [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Booting with volume snapshot 02d4b237-1279-4067-943f-ebc265b456e3 at /dev/vda
Nov 09 00:57:54 user nova-compute[74441]: DEBUG nova.policy [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd80ab02de6b249c3adecf0597940ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9194fd2e7248a2bdbfd3d57f846fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:57:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Successfully created port: a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG nova.network.neutron [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Successfully updated port: a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "refresh_cache-eaba06fc-d11e-458c-b7b5-1f8681768586" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquired lock "refresh_cache-eaba06fc-d11e-458c-b7b5-1f8681768586" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG nova.network.neutron [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-changed-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Refreshing instance network info cache due to event network-changed-a8522639-221b-4f46-805b-26c2f2b10dc9. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] Acquiring lock "refresh_cache-eaba06fc-d11e-458c-b7b5-1f8681768586" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:56 user nova-compute[74441]: DEBUG nova.network.neutron [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Updating instance_info_cache with network_info: [{"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Releasing lock "refresh_cache-eaba06fc-d11e-458c-b7b5-1f8681768586" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Instance network_info: |[{"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] Acquired lock "refresh_cache-eaba06fc-d11e-458c-b7b5-1f8681768586" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.network.neutron [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Refreshing network info cache for port a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updating instance_info_cache with network_info: [{"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.network.neutron [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Updated VIF entry in instance network info cache for port a8522639-221b-4f46-805b-26c2f2b10dc9. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG nova.network.neutron [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Updating instance_info_cache with network_info: [{"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:57:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ee17d903-7b98-4f9f-bef1-e75cea68ac5b req-56c91402-0986-49c9-8d65-bc8fd4d717eb service nova] Releasing lock "refresh_cache-eaba06fc-d11e-458c-b7b5-1f8681768586" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:57:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:57:59 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:03 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:58:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG os_brick.utils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1f6026-8bcd-44c8-bbeb-fbadf50864ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a2088-d96c-4843-83b8-19b39e1ea5e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a9bff4-818f-417c-b40c-241c4c1ef894]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e90b1a-75d7-41c0-b831-3279b039c568]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:58:06 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e261b09-e876-4e6b-966a-2130feaa2af6]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG os_brick.utils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Updating existing volume attachment record: 33831255-5eb7-4559-8842-54a3ee08beaf {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:07 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:07 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:07 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.068138122558594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance eaba06fc-d11e-458c-b7b5-1f8681768586 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lvrYtjWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:10 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:10 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:10 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ffd66-0c96-4975-9dd2-94cda3a52da4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:58:10 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e404ed-9ba9-41e5-98f3-429d9aa62cbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2] added
Nov 09 00:58:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeKMUuqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:10 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f1096e-8225-458d-a8f6-c181b55ed4a3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7981132-3695-4efc-b92e-14e931203888]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lvrYtjWg {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lvrYtjWg" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c101e-4187-4544-a051-0908af891f25]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lvrYtjWg'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3792f-4e25-439e-b421-a93173269640]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed201b-32c4-4347-b654-5e6ecc775386]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3163337f-792e-49da-9a5f-ae97cbf14e53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260]
Nov 09 00:58:10 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260] successful.
Nov 09 00:58:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b4b819-93af-46d1-b22f-6f877be0eb46]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66ddd21-4f00-4389-81e2-f3f515ddca17]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:10 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:10 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d04f0d1-c52a-42b3-8228-30d5bde14d90]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:58:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lvrYtjWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26235663631663531', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235663631663531', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.286s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:11 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:11 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 28c6a03d-4257-41ff-8fdf-7863286b9b03 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[844657f1-7d30-48b5-a3df-0aed07101a77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:58:11 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:58:11 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:58:11 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 00:58:11 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:58:11 user nova-compute[74441]:   <serial>a5632f8f-dae5-4f98-88b4-ae8ef309aee2</serial>
Nov 09 00:58:11 user nova-compute[74441]: </disk>
Nov 09 00:58:11 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b66d8a-c746-46c7-be9c-426f7bd67958]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9] added
Nov 09 00:58:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf51844-1284-4fed-a769-5b5b9766873a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea85e1b-1cf2-4b14-8d37-b55481f17d5a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeKMUuqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeKMUuqn" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e8f878-8e47-4a66-aa1b-a438f3d2d273]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeKMUuqn'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec154b5a-3dbb-4abd-be3d-7fa0c7b96cc5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc589fb-aa45-44c0-91dd-5eeefd14c536]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78223483-632e-48a4-9fc7-27eaad72cdab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260]
Nov 09 00:58:11 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260] successful.
Nov 09 00:58:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a3196-602e-4024-a792-c0932a39db82]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e900ffac-0f0f-4622-90b8-5cbe3fce56e9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266b059-b54e-44b9-a904-359987c08f8f]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:58:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeKMUuqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:31:bd:c8, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4e1b83bf-e218-428f-8aba-bbe2a82e1f90 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.139s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] <== connect_volume: return (2643ms) {'type': 'block', 'scsi_wwn': '26439613066313035', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439613066313035', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'flavor' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 00:58:12 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:58:12 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 00:58:12 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 00:58:12 user nova-compute[74441]:   <serial>fec3dc9a-166b-4b6c-80af-c63ec20058b9</serial>
Nov 09 00:58:12 user nova-compute[74441]: </disk>
Nov 09 00:58:12 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 00:58:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No VIF found with MAC fa:16:3e:eb:16:fe, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:58:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-69850be5-e221-4781-8ae7-c8838b9faa64 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.970s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:14 user nova-compute[74441]: INFO nova.compute.manager [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Rescuing
Nov 09 00:58:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-713456a2-7523-47d8-89f5-99d4703b5e30 req-63e18590-d564-46be-8647-aaa073ebd53b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-713456a2-7523-47d8-89f5-99d4703b5e30 req-63e18590-d564-46be-8647-aaa073ebd53b service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-713456a2-7523-47d8-89f5-99d4703b5e30 req-63e18590-d564-46be-8647-aaa073ebd53b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-713456a2-7523-47d8-89f5-99d4703b5e30 req-63e18590-d564-46be-8647-aaa073ebd53b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-713456a2-7523-47d8-89f5-99d4703b5e30 req-63e18590-d564-46be-8647-aaa073ebd53b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:15 user nova-compute[74441]: WARNING nova.compute.manager [req-713456a2-7523-47d8-89f5-99d4703b5e30 req-63e18590-d564-46be-8647-aaa073ebd53b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state active and task_state rescuing.
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance destroyed successfully.
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:58:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Attempting a stable device rescue
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 00:58:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Creating image(s)
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "ae004f3af2a190f9055f550d1d146714a0425048" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "ae004f3af2a190f9055f550d1d146714a0425048" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:15 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:58:15 user nova-compute[74441]: INFO nova.compute.claims [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Claim successful on node user
Nov 09 00:58:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.part --force-share --output=json" returned: 0 in 0.222s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:16 user nova-compute[74441]: DEBUG nova.virt.images [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] c42f6ae9-8b27-4794-b2f7-ff82e9a3b74e was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 00:58:16 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:58:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.part /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-48bceecd-50e0-42c4-bbd5-7b62c97851a8 req-33cd55df-f763-4328-b0fe-70238ff91f31 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-48bceecd-50e0-42c4-bbd5-7b62c97851a8 req-33cd55df-f763-4328-b0fe-70238ff91f31 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-48bceecd-50e0-42c4-bbd5-7b62c97851a8 req-33cd55df-f763-4328-b0fe-70238ff91f31 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-48bceecd-50e0-42c4-bbd5-7b62c97851a8 req-33cd55df-f763-4328-b0fe-70238ff91f31 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-48bceecd-50e0-42c4-bbd5-7b62c97851a8 req-33cd55df-f763-4328-b0fe-70238ff91f31 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:17 user nova-compute[74441]: WARNING nova.compute.manager [req-48bceecd-50e0-42c4-bbd5-7b62c97851a8 req-33cd55df-f763-4328-b0fe-70238ff91f31 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state active and task_state rescuing.
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.731s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:58:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.part /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.converted" returned: 0 in 0.729s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.policy [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '156577f25fe04e6e8ac3612c2a0dbc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e49bf75726243749bace44e94c1397b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:58:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Creating image(s)
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "ae004f3af2a190f9055f550d1d146714a0425048" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.338s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "ae004f3af2a190f9055f550d1d146714a0425048" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "ae004f3af2a190f9055f550d1d146714a0425048" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048,backing_fmt=raw /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048,backing_fmt=raw /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue" returned: 0 in 0.055s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "ae004f3af2a190f9055f550d1d146714a0425048" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'migration_context' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Object Instance<b2c005b6-7adc-45e8-8539-8fd4306051d3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Start _get_guest_xml network_info=[{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "vif_mac": "fa:16:3e:eb:16:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c42f6ae9-8b27-4794-b2f7-ff82e9a3b74e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeKMUuqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b2c005b6-7adc-45e8-8539-8fd4306051d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'serial': 'fec3dc9a-166b-4b6c-80af-c63ec20058b9'}, 'attachment_id': '87b8a7f2-071f-4146-874f-86e9ce5d2ccc', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'resources' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Object Instance<b2c005b6-7adc-45e8-8539-8fd4306051d3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'numa_topology' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk 1073741824" returned: 0 in 0.060s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Object Instance<b2c005b6-7adc-45e8-8539-8fd4306051d3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:58:18 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:18 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Object Instance<b2c005b6-7adc-45e8-8539-8fd4306051d3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeKMUuqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:18 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:18 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:18 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a062837-d372-43fb-b6dd-d2cff8029336]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JeKMUuqn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 00:58:18 user nova-compute[74441]: node.name = iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9
Nov 09 00:58:18 user nova-compute[74441]: node.tpgt = -1
Nov 09 00:58:18 user nova-compute[74441]: node.startup = automatic
Nov 09 00:58:18 user nova-compute[74441]: node.leading_login = No
Nov 09 00:58:18 user nova-compute[74441]: iface.iscsi_ifacename = default
Nov 09 00:58:18 user nova-compute[74441]: iface.net_ifacename = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.ipaddress = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.prefix_len = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.hwaddress = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.transport_name = tcp
Nov 09 00:58:18 user nova-compute[74441]: iface.initiatorname = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.vlan_id = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.vlan_priority = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.vlan_state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.iface_num = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.mtu = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.port = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.bootproto = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.subnet_mask = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.gateway = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_alt_client_id = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_dns = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_learn_iqn = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_vendor_id_state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_vendor_id = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.dhcp_slp_da = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.fragmentation = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.gratuitous_arp = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.incoming_forwarding = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.tos_state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.tos = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.ttl = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.delayed_ack = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.tcp_nagle = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.tcp_wsf_state = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.tcp_wsf = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.tcp_timer_scale = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.tcp_timestamp = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.redirect = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.def_task_mgmt_timeout = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.header_digest = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.data_digest = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.immediate_data = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.initial_r2t = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.data_seq_inorder = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.data_pdu_inorder = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.erl = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.max_receive_data_len = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.first_burst_len = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.max_outstanding_r2t = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.max_burst_len = 0
Nov 09 00:58:18 user nova-compute[74441]: iface.chap_auth = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.bidi_chap = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.strict_login_compliance = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.discovery_auth = <empty>
Nov 09 00:58:18 user nova-compute[74441]: iface.discovery_logout = <empty>
Nov 09 00:58:18 user nova-compute[74441]: node.discovery_address = <empty>
Nov 09 00:58:18 user nova-compute[74441]: node.discovery_port = 0
Nov 09 00:58:18 user nova-compute[74441]: node.discovery_type = static
Nov 09 00:58:18 user nova-compute[74441]: node.session.initial_cmdsn = 0
Nov 09 00:58:18 user nova-compute[74441]: node.session.initial_login_retry_max = 8
Nov 09 00:58:18 user nova-compute[74441]: node.session.xmit_thread_priority = -20
Nov 09 00:58:18 user nova-compute[74441]: node.session.cmds_max = 128
Nov 09 00:58:18 user nova-compute[74441]: node.session.queue_depth = 32
Nov 09 00:58:18 user nova-compute[74441]: node.session.nr_sessions = 1
Nov 09 00:58:18 user nova-compute[74441]: node.session.auth.authmethod = CHAP
Nov 09 00:58:18 user nova-compute[74441]: node.session.auth.username = JeKMUuqn
Nov 09 00:58:18 user nova-compute[74441]: node.session.auth.password = ***
Nov 09 00:58:18 user nova-compute[74441]: node.session.auth.username_in = <empty>
Nov 09 00:58:18 user nova-compute[74441]: node.session.auth.password_in = <empty>
Nov 09 00:58:18 user nova-compute[74441]: node.session.auth.chap_algs = MD5
Nov 09 00:58:18 user nova-compute[74441]: node.session.timeo.replacement_timeout = 120
Nov 09 00:58:18 user nova-compute[74441]: node.session.err_timeo.abort_timeout = 15
Nov 09 00:58:18 user nova-compute[74441]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 00:58:18 user nova-compute[74441]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 00:58:18 user nova-compute[74441]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.FastAbort = Yes
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.InitialR2T = No
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.ImmediateData = Yes
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.MaxConnections = 1
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 00:58:18 user nova-compute[74441]: node.session.iscsi.ERL = 0
Nov 09 00:58:18 user nova-compute[74441]: node.session.scan = manual
Nov 09 00:58:18 user nova-compute[74441]: node.session.reopen_max = 0
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].address = 172.16.0.220
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].port = 3260
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].startup = manual
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].tcp.window_size = 524288
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].tcp.type_of_service = 0
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].timeo.logout_timeout = 15
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].timeo.login_timeout = 15
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].timeo.auth_timeout = 45
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].iscsi.DataDigest = None
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].iscsi.IFMarker = No
Nov 09 00:58:18 user nova-compute[74441]: node.conn[0].iscsi.OFMarker = No
Nov 09 00:58:18 user nova-compute[74441]: # END RECORD
Nov 09 00:58:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d49318-da8e-4218-9dc7-4881acc68168]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26fc38b-9a54-4503-a9ce-e0e5d960e051]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeKMUuqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Successfully created port: 05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.262s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeKMUuqn" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7be78a-b593-4392-bf99-4b2c2280c81f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeKMUuqn'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[013988a2-810f-43f0-bcca-afbc8f7b8926]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6560ae-b5af-4784-bb04-5ba8e662b6ac]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:18 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:18 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:18 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:18 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.200s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] HCTL ('35', '0', '0', 0) found on session 30 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09911e7-fe92-4a55-862a-e89bc56c8fe8]: (4, ('0 0 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Searching for a device in session 30 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeKMUuqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.227s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] <== connect_volume: return (229ms) {'type': 'block', 'scsi_wwn': '26439613066313035', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439613066313035', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-19428943',display_name='tempest-ServerStableDeviceRescueTest-server-19428943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-19428943',id=25,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4LPSIna8kft7F4sBbm/duxspyUfEVb9REdJOUO2pZWntMsgKir3VHMUe6SlTp8yatezmObML5DzdDAQflmKIKLSd0OQpmkHn0ooQSn2FtV8M9rMw7LYrkrTquMBagW9w==',key_name='tempest-keypair-496424780',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b33fe89e4a824e22a4bea354a547302f',ramdisk_id='',reservation_id='r-1hwhh3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1228913245',owner_user_name='tempest-ServerStableDeviceRescueTest-1228913245-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741a4f427124857be6d3d1f1e512eb0',uuid=b2c005b6-7adc-45e8-8539-8fd4306051d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "vif_mac": "fa:16:3e:eb:16:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converting VIF {"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "vif_mac": "fa:16:3e:eb:16:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Cannot resize image /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.objects.base [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Object Instance<b2c005b6-7adc-45e8-8539-8fd4306051d3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:58:18 user nova-compute[74441]:   <uuid>b2c005b6-7adc-45e8-8539-8fd4306051d3</uuid>
Nov 09 00:58:18 user nova-compute[74441]:   <name>instance-00000019</name>
Nov 09 00:58:18 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:58:18 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:58:18 user nova-compute[74441]:   <metadata>
Nov 09 00:58:18 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:58:18 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:58:18 user nova-compute[74441]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-19428943</nova:name>
Nov 09 00:58:18 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:58:18</nova:creationTime>
Nov 09 00:58:18 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:58:18 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:58:18 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:58:18 user nova-compute[74441]:       <nova:owner>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:user uuid="9741a4f427124857be6d3d1f1e512eb0">tempest-ServerStableDeviceRescueTest-1228913245-project-member</nova:user>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:project uuid="b33fe89e4a824e22a4bea354a547302f">tempest-ServerStableDeviceRescueTest-1228913245</nova:project>
Nov 09 00:58:18 user nova-compute[74441]:       </nova:owner>
Nov 09 00:58:18 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:58:18 user nova-compute[74441]:       <nova:ports>
Nov 09 00:58:18 user nova-compute[74441]:         <nova:port uuid="494268cb-cba1-478a-a7a2-7657f2134dd5">
Nov 09 00:58:18 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 00:58:18 user nova-compute[74441]:         </nova:port>
Nov 09 00:58:18 user nova-compute[74441]:       </nova:ports>
Nov 09 00:58:18 user nova-compute[74441]:     </nova:instance>
Nov 09 00:58:18 user nova-compute[74441]:   </metadata>
Nov 09 00:58:18 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:58:18 user nova-compute[74441]:     <system>
Nov 09 00:58:18 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:58:18 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:58:18 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:58:18 user nova-compute[74441]:       <entry name="serial">b2c005b6-7adc-45e8-8539-8fd4306051d3</entry>
Nov 09 00:58:18 user nova-compute[74441]:       <entry name="uuid">b2c005b6-7adc-45e8-8539-8fd4306051d3</entry>
Nov 09 00:58:18 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:58:18 user nova-compute[74441]:     </system>
Nov 09 00:58:18 user nova-compute[74441]:   </sysinfo>
Nov 09 00:58:18 user nova-compute[74441]:   <os>
Nov 09 00:58:18 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:58:18 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:58:18 user nova-compute[74441]:   </os>
Nov 09 00:58:18 user nova-compute[74441]:   <features>
Nov 09 00:58:18 user nova-compute[74441]:     <acpi/>
Nov 09 00:58:18 user nova-compute[74441]:     <apic/>
Nov 09 00:58:18 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:58:18 user nova-compute[74441]:   </features>
Nov 09 00:58:18 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:58:18 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:58:18 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:58:18 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:58:18 user nova-compute[74441]:   </clock>
Nov 09 00:58:18 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:58:18 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:58:18 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:58:18 user nova-compute[74441]:   </cpu>
Nov 09 00:58:18 user nova-compute[74441]:   <devices>
Nov 09 00:58:18 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:58:18 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:58:18 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk"/>
Nov 09 00:58:18 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:58:18 user nova-compute[74441]:     </disk>
Nov 09 00:58:18 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:58:18 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:58:18 user nova-compute[74441]:       <source dev="/dev/sdd"/>
Nov 09 00:58:18 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 00:58:18 user nova-compute[74441]:       <serial>fec3dc9a-166b-4b6c-80af-c63ec20058b9</serial>
Nov 09 00:58:18 user nova-compute[74441]:     </disk>
Nov 09 00:58:18 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:58:18 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:58:18 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue"/>
Nov 09 00:58:18 user nova-compute[74441]:       <target dev="vdc" bus="virtio"/>
Nov 09 00:58:18 user nova-compute[74441]:       <boot order="1"/>
Nov 09 00:58:18 user nova-compute[74441]:     </disk>
Nov 09 00:58:18 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:58:18 user nova-compute[74441]:       <mac address="fa:16:3e:eb:16:fe"/>
Nov 09 00:58:18 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:18 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:58:18 user nova-compute[74441]:       <target dev="tap494268cb-cb"/>
Nov 09 00:58:18 user nova-compute[74441]:     </interface>
Nov 09 00:58:18 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:58:18 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/console.log" append="off"/>
Nov 09 00:58:18 user nova-compute[74441]:     </serial>
Nov 09 00:58:18 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:58:18 user nova-compute[74441]:     <video>
Nov 09 00:58:18 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:18 user nova-compute[74441]:     </video>
Nov 09 00:58:18 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:58:18 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:58:18 user nova-compute[74441]:     </rng>
Nov 09 00:58:18 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:58:18 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:58:18 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:58:18 user nova-compute[74441]:     </memballoon>
Nov 09 00:58:18 user nova-compute[74441]:   </devices>
Nov 09 00:58:18 user nova-compute[74441]: </domain>
Nov 09 00:58:18 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:58:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance destroyed successfully.
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] No VIF found with MAC fa:16:3e:eb:16:fe, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Successfully updated port: 05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquired lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-changed-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Refreshing instance network info cache due to event network-changed-05a926f9-c876-4177-a58d-8a603a619d10. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] Acquiring lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Updating instance_info_cache with network_info: [{"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Releasing lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Instance network_info: |[{"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] Acquired lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Refreshing network info cache for port 05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Start _get_guest_xml network_info=[{"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:58:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-857411949',display_name='tempest-AttachVolumeNegativeTest-server-857411949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-857411949',id=31,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZj7v45fnFHoySqDYenafSOob1rt6//M6Gm8Zx/E42TkiTdRkiGuhZeG5Pz7smisjeW1ReMfHK5DHFyQagWLKfC8d4R0Ar5UaMPpfcr/yOFkYkyh2XZV9nZ69tEJN2mOQ==',key_name='tempest-keypair-1859582499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-9br3ro3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:58:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=a1a0ef75-791d-4e14-bc0d-65471b48e4ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a0ef75-791d-4e14-bc0d-65471b48e4ca {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:58:19 user nova-compute[74441]:   <uuid>a1a0ef75-791d-4e14-bc0d-65471b48e4ca</uuid>
Nov 09 00:58:19 user nova-compute[74441]:   <name>instance-0000001f</name>
Nov 09 00:58:19 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:58:19 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:58:19 user nova-compute[74441]:   <metadata>
Nov 09 00:58:19 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:58:19 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:58:19 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-857411949</nova:name>
Nov 09 00:58:19 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:58:19</nova:creationTime>
Nov 09 00:58:19 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:58:19 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:58:19 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:58:19 user nova-compute[74441]:       <nova:owner>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:user uuid="156577f25fe04e6e8ac3612c2a0dbc4d">tempest-AttachVolumeNegativeTest-595140925-project-member</nova:user>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:project uuid="8e49bf75726243749bace44e94c1397b">tempest-AttachVolumeNegativeTest-595140925</nova:project>
Nov 09 00:58:19 user nova-compute[74441]:       </nova:owner>
Nov 09 00:58:19 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 00:58:19 user nova-compute[74441]:       <nova:ports>
Nov 09 00:58:19 user nova-compute[74441]:         <nova:port uuid="05a926f9-c876-4177-a58d-8a603a619d10">
Nov 09 00:58:19 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 00:58:19 user nova-compute[74441]:         </nova:port>
Nov 09 00:58:19 user nova-compute[74441]:       </nova:ports>
Nov 09 00:58:19 user nova-compute[74441]:     </nova:instance>
Nov 09 00:58:19 user nova-compute[74441]:   </metadata>
Nov 09 00:58:19 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:58:19 user nova-compute[74441]:     <system>
Nov 09 00:58:19 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:58:19 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:58:19 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:58:19 user nova-compute[74441]:       <entry name="serial">a1a0ef75-791d-4e14-bc0d-65471b48e4ca</entry>
Nov 09 00:58:19 user nova-compute[74441]:       <entry name="uuid">a1a0ef75-791d-4e14-bc0d-65471b48e4ca</entry>
Nov 09 00:58:19 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:58:19 user nova-compute[74441]:     </system>
Nov 09 00:58:19 user nova-compute[74441]:   </sysinfo>
Nov 09 00:58:19 user nova-compute[74441]:   <os>
Nov 09 00:58:19 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:58:19 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:58:19 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:58:19 user nova-compute[74441]:   </os>
Nov 09 00:58:19 user nova-compute[74441]:   <features>
Nov 09 00:58:19 user nova-compute[74441]:     <acpi/>
Nov 09 00:58:19 user nova-compute[74441]:     <apic/>
Nov 09 00:58:19 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:58:19 user nova-compute[74441]:   </features>
Nov 09 00:58:19 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:58:19 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:58:19 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:58:19 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:58:19 user nova-compute[74441]:   </clock>
Nov 09 00:58:19 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:58:19 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:58:19 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:58:19 user nova-compute[74441]:   </cpu>
Nov 09 00:58:19 user nova-compute[74441]:   <devices>
Nov 09 00:58:19 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 00:58:19 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 00:58:19 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk"/>
Nov 09 00:58:19 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:58:19 user nova-compute[74441]:     </disk>
Nov 09 00:58:19 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:58:19 user nova-compute[74441]:       <mac address="fa:16:3e:89:01:f8"/>
Nov 09 00:58:19 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:19 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:58:19 user nova-compute[74441]:       <target dev="tap05a926f9-c8"/>
Nov 09 00:58:19 user nova-compute[74441]:     </interface>
Nov 09 00:58:19 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:58:19 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/console.log" append="off"/>
Nov 09 00:58:19 user nova-compute[74441]:     </serial>
Nov 09 00:58:19 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:58:19 user nova-compute[74441]:     <video>
Nov 09 00:58:19 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:19 user nova-compute[74441]:     </video>
Nov 09 00:58:19 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:58:19 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:58:19 user nova-compute[74441]:     </rng>
Nov 09 00:58:19 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:58:19 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:58:19 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:58:19 user nova-compute[74441]:     </memballoon>
Nov 09 00:58:19 user nova-compute[74441]:   </devices>
Nov 09 00:58:19 user nova-compute[74441]: </domain>
Nov 09 00:58:19 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-857411949',display_name='tempest-AttachVolumeNegativeTest-server-857411949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-857411949',id=31,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZj7v45fnFHoySqDYenafSOob1rt6//M6Gm8Zx/E42TkiTdRkiGuhZeG5Pz7smisjeW1ReMfHK5DHFyQagWLKfC8d4R0Ar5UaMPpfcr/yOFkYkyh2XZV9nZ69tEJN2mOQ==',key_name='tempest-keypair-1859582499',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-9br3ro3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:58:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=a1a0ef75-791d-4e14-bc0d-65471b48e4ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG os_vif [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13f405fb-c6d1-55ab-bef2-e1037d3e3c12', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05a926f9-c8, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05a926f9-c8, col_values=(('qos', UUID('8ded1f5e-5855-47f2-b6f5-fe71b9367e03')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05a926f9-c8, col_values=(('external_ids', {'iface-id': '05a926f9-c876-4177-a58d-8a603a619d10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:01:f8', 'vm-uuid': 'a1a0ef75-791d-4e14-bc0d-65471b48e4ca'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:19 user nova-compute[74441]: INFO os_vif [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8')
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:89:01:f8, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Updated VIF entry in instance network info cache for port 05a926f9-c876-4177-a58d-8a603a619d10. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Updating instance_info_cache with network_info: [{"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d7ba7f7b-0125-4b1a-a2ec-a5171ddfcc9c req-d690d836-dceb-4e68-9cc0-20513eaae7c3 service nova] Releasing lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:21 user nova-compute[74441]: WARNING nova.compute.manager [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state active and task_state rescuing.
Nov 09 00:58:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:21 user nova-compute[74441]: WARNING nova.compute.manager [req-f2267190-2dcd-4640-8604-c4e0800d88f9 req-c57f0b00-879a-489a-ba2d-f78f1911e12c service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state active and task_state rescuing.
Nov 09 00:58:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-11b0a1bf-4966-47fe-8190-d5453bab4b0c req-ccb7d84c-0581-42f1-82ba-5b2d7558b0b2 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-11b0a1bf-4966-47fe-8190-d5453bab4b0c req-ccb7d84c-0581-42f1-82ba-5b2d7558b0b2 service nova] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-11b0a1bf-4966-47fe-8190-d5453bab4b0c req-ccb7d84c-0581-42f1-82ba-5b2d7558b0b2 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-11b0a1bf-4966-47fe-8190-d5453bab4b0c req-ccb7d84c-0581-42f1-82ba-5b2d7558b0b2 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-11b0a1bf-4966-47fe-8190-d5453bab4b0c req-ccb7d84c-0581-42f1-82ba-5b2d7558b0b2 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] No waiting events found dispatching network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:22 user nova-compute[74441]: WARNING nova.compute.manager [req-11b0a1bf-4966-47fe-8190-d5453bab4b0c req-ccb7d84c-0581-42f1-82ba-5b2d7558b0b2 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received unexpected event network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 for instance with vm_state building and task_state spawning.
Nov 09 00:58:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:58:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Instance spawned successfully.
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-fd342adc-5fd2-4597-a56e-e4d5474ccce7 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a3b71d2-278b-41d9-a94d-dcc0bc60f299 req-94f83f01-a92b-433e-b9cc-f263d193e6c8 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a3b71d2-278b-41d9-a94d-dcc0bc60f299 req-94f83f01-a92b-433e-b9cc-f263d193e6c8 service nova] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a3b71d2-278b-41d9-a94d-dcc0bc60f299 req-94f83f01-a92b-433e-b9cc-f263d193e6c8 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a3b71d2-278b-41d9-a94d-dcc0bc60f299 req-94f83f01-a92b-433e-b9cc-f263d193e6c8 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a3b71d2-278b-41d9-a94d-dcc0bc60f299 req-94f83f01-a92b-433e-b9cc-f263d193e6c8 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] No waiting events found dispatching network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:24 user nova-compute[74441]: WARNING nova.compute.manager [req-3a3b71d2-278b-41d9-a94d-dcc0bc60f299 req-94f83f01-a92b-433e-b9cc-f263d193e6c8 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received unexpected event network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 for instance with vm_state building and task_state spawning.
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:24 user nova-compute[74441]: INFO nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 00:58:24 user nova-compute[74441]: INFO nova.compute.claims [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Claim successful on node user
Nov 09 00:58:24 user nova-compute[74441]: INFO nova.compute.manager [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Took 8.88 seconds to build instance.
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-350d4f7b-6dc9-4d7b-a122-45299f5cbfe4 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.051s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 00:58:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 00:58:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG nova.policy [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dee4ca1b1a8d432d943ba7bf20f41f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c24e7fc6e24dd0bc5c8ca3bfd1166f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 00:58:25 user nova-compute[74441]: INFO nova.virt.block_device [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Booting with volume c314dc54-4f09-43d1-9850-df397db83124 at /dev/vda
Nov 09 00:58:25 user nova-compute[74441]: DEBUG os_brick.utils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d26dcbd-038d-4b06-9d1d-f20c4c13789d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d6f180-29b3-44d3-81d3-1099da0662db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea11e892-b59c-4a17-9034-769c5d01863f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbba7a27-257c-4f92-aff1-2d58ee47e52a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:58:25 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:58:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b208ff-7d32-4393-ad00-d94b6d39aaa3]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG os_brick.utils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:25 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating existing volume attachment record: 7e9ebbfa-b8ee-408e-b0f8-45c4e8c8e9e5 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Successfully created port: 56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Successfully updated port: 56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquired lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-changed-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Refreshing instance network info cache due to event network-changed-56411d66-37db-4073-959a-01c9c64508e9. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:58:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] Acquiring lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:58:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 00:58:27 user nova-compute[74441]: DEBUG nova.network.neutron [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:58:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Releasing lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:58:27 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance network_info: |[{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 00:58:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] Acquired lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:58:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Refreshing network info cache for port 56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:58:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updated VIF entry in instance network info cache for port 56411d66-37db-4073-959a-01c9c64508e9. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:58:28 user nova-compute[74441]: DEBUG nova.network.neutron [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:58:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fc318a7e-d251-4df2-882f-422c7d84297f req-8ff6d973-c2c0-4a30-8014-80ebdf1f334c service nova] Releasing lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:58:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:58:32 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Creating image(s)
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Ensure instance console log exists: /opt/stack/data/nova/instances/eaba06fc-d11e-458c-b7b5-1f8681768586/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Start _get_guest_xml network_info=[{"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkAViWcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eaba06fc-d11e-458c-b7b5-1f8681768586', 'attached_at': '', 'detached_at': '', 'volume_id': '358ae73b-8502-42bc-be3b-a6232592b9b0', 'serial': '358ae73b-8502-42bc-be3b-a6232592b9b0'}, 'attachment_id': '33831255-5eb7-4559-8842-54a3ee08beaf', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:58:32 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:32 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkAViWcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:32 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d72f7-ca90-4f93-a4e6-af967535049a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:58:32 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e0bd1b-edb6-456f-bd98-b188b66068da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0] added
Nov 09 00:58:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7639905a-ecc6-4e81-902b-0b8836c942a7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ce6bf7-4bd7-4e6f-b10b-5cf05aac8f73]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkAViWcz {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkAViWcz" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2435c51c-f11d-4186-8a1a-3683da336914]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XkAViWcz'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ae9ee1-dc36-480b-bd46-762852d6ae10]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8268e9d-ef70-4aa4-b1b4-accfdf8d6a92]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:32 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:32 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:32 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:32 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8bf6e-1f38-450f-8973-edd0ce6c305a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260]
Nov 09 00:58:32 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260] successful.
Nov 09 00:58:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb5aa50-04e3-4ea2-a5d4-86f6f59cda6a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1d286-5c03-41cd-b829-fc2c379f1b99]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:58:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e890334-f65f-4f23-ad58-3e4ee2617bc4]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkAViWcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26233316132303333', 'path': '/dev/sde'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233316132303333', 'path': '/dev/sde'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-22445469',display_name='tempest-TestVolumeBootPattern-server-22445469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-22445469',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-3savn378',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:57:55Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=eaba06fc-d11e-458c-b7b5-1f8681768586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'pci_devices' on Instance uuid eaba06fc-d11e-458c-b7b5-1f8681768586 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:58:34 user nova-compute[74441]:   <uuid>eaba06fc-d11e-458c-b7b5-1f8681768586</uuid>
Nov 09 00:58:34 user nova-compute[74441]:   <name>instance-0000001e</name>
Nov 09 00:58:34 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:58:34 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:58:34 user nova-compute[74441]:   <metadata>
Nov 09 00:58:34 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:58:34 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:58:34 user nova-compute[74441]:       <nova:name>tempest-TestVolumeBootPattern-server-22445469</nova:name>
Nov 09 00:58:34 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:58:32</nova:creationTime>
Nov 09 00:58:34 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:58:34 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:58:34 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:58:34 user nova-compute[74441]:       <nova:owner>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:user uuid="d80ab02de6b249c3adecf0597940ea76">tempest-TestVolumeBootPattern-1724241999-project-member</nova:user>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:project uuid="ad9194fd2e7248a2bdbfd3d57f846fed">tempest-TestVolumeBootPattern-1724241999</nova:project>
Nov 09 00:58:34 user nova-compute[74441]:       </nova:owner>
Nov 09 00:58:34 user nova-compute[74441]:       <nova:ports>
Nov 09 00:58:34 user nova-compute[74441]:         <nova:port uuid="a8522639-221b-4f46-805b-26c2f2b10dc9">
Nov 09 00:58:34 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 00:58:34 user nova-compute[74441]:         </nova:port>
Nov 09 00:58:34 user nova-compute[74441]:       </nova:ports>
Nov 09 00:58:34 user nova-compute[74441]:     </nova:instance>
Nov 09 00:58:34 user nova-compute[74441]:   </metadata>
Nov 09 00:58:34 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:58:34 user nova-compute[74441]:     <system>
Nov 09 00:58:34 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:58:34 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:58:34 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:58:34 user nova-compute[74441]:       <entry name="serial">eaba06fc-d11e-458c-b7b5-1f8681768586</entry>
Nov 09 00:58:34 user nova-compute[74441]:       <entry name="uuid">eaba06fc-d11e-458c-b7b5-1f8681768586</entry>
Nov 09 00:58:34 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:58:34 user nova-compute[74441]:     </system>
Nov 09 00:58:34 user nova-compute[74441]:   </sysinfo>
Nov 09 00:58:34 user nova-compute[74441]:   <os>
Nov 09 00:58:34 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:58:34 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:58:34 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:58:34 user nova-compute[74441]:   </os>
Nov 09 00:58:34 user nova-compute[74441]:   <features>
Nov 09 00:58:34 user nova-compute[74441]:     <acpi/>
Nov 09 00:58:34 user nova-compute[74441]:     <apic/>
Nov 09 00:58:34 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:58:34 user nova-compute[74441]:   </features>
Nov 09 00:58:34 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:58:34 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:58:34 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:58:34 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:58:34 user nova-compute[74441]:   </clock>
Nov 09 00:58:34 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:58:34 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:58:34 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:58:34 user nova-compute[74441]:   </cpu>
Nov 09 00:58:34 user nova-compute[74441]:   <devices>
Nov 09 00:58:34 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:58:34 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:58:34 user nova-compute[74441]:       <source dev="/dev/sde"/>
Nov 09 00:58:34 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:58:34 user nova-compute[74441]:       <serial>358ae73b-8502-42bc-be3b-a6232592b9b0</serial>
Nov 09 00:58:34 user nova-compute[74441]:     </disk>
Nov 09 00:58:34 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:58:34 user nova-compute[74441]:       <mac address="fa:16:3e:18:14:bc"/>
Nov 09 00:58:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:34 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:58:34 user nova-compute[74441]:       <target dev="tapa8522639-22"/>
Nov 09 00:58:34 user nova-compute[74441]:     </interface>
Nov 09 00:58:34 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:58:34 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/eaba06fc-d11e-458c-b7b5-1f8681768586/console.log" append="off"/>
Nov 09 00:58:34 user nova-compute[74441]:     </serial>
Nov 09 00:58:34 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:58:34 user nova-compute[74441]:     <video>
Nov 09 00:58:34 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:34 user nova-compute[74441]:     </video>
Nov 09 00:58:34 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:58:34 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:58:34 user nova-compute[74441]:     </rng>
Nov 09 00:58:34 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:58:34 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:58:34 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:58:34 user nova-compute[74441]:     </memballoon>
Nov 09 00:58:34 user nova-compute[74441]:   </devices>
Nov 09 00:58:34 user nova-compute[74441]: </domain>
Nov 09 00:58:34 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-22445469',display_name='tempest-TestVolumeBootPattern-server-22445469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-22445469',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-3savn378',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:57:55Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=eaba06fc-d11e-458c-b7b5-1f8681768586,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG os_vif [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '697e0b13-6842-5d49-8b85-adc0b9ada7f9', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8522639-22, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8522639-22, col_values=(('qos', UUID('a29ce311-6f02-4a33-9c9c-3444a66e95a1')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8522639-22, col_values=(('external_ids', {'iface-id': 'a8522639-221b-4f46-805b-26c2f2b10dc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:14:bc', 'vm-uuid': 'eaba06fc-d11e-458c-b7b5-1f8681768586'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:34 user nova-compute[74441]: INFO os_vif [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22')
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No VIF found with MAC fa:16:3e:18:14:bc, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-70174059-2171-48ba-9e3b-c0aaa6817693 req-8ad5190f-1ba0-4d75-a7c8-82303859e871 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-70174059-2171-48ba-9e3b-c0aaa6817693 req-8ad5190f-1ba0-4d75-a7c8-82303859e871 service nova] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-70174059-2171-48ba-9e3b-c0aaa6817693 req-8ad5190f-1ba0-4d75-a7c8-82303859e871 service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-70174059-2171-48ba-9e3b-c0aaa6817693 req-8ad5190f-1ba0-4d75-a7c8-82303859e871 service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-70174059-2171-48ba-9e3b-c0aaa6817693 req-8ad5190f-1ba0-4d75-a7c8-82303859e871 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] No waiting events found dispatching network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:35 user nova-compute[74441]: WARNING nova.compute.manager [req-70174059-2171-48ba-9e3b-c0aaa6817693 req-8ad5190f-1ba0-4d75-a7c8-82303859e871 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received unexpected event network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 for instance with vm_state building and task_state spawning.
Nov 09 00:58:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:58:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Instance spawned successfully.
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:37 user nova-compute[74441]: INFO nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-24f1ca4e-c020-43b2-b837-389ffe4d0f3d req-c02d0b99-abf6-44d1-87ff-0e8b34bbb855 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-24f1ca4e-c020-43b2-b837-389ffe4d0f3d req-c02d0b99-abf6-44d1-87ff-0e8b34bbb855 service nova] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-24f1ca4e-c020-43b2-b837-389ffe4d0f3d req-c02d0b99-abf6-44d1-87ff-0e8b34bbb855 service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-24f1ca4e-c020-43b2-b837-389ffe4d0f3d req-c02d0b99-abf6-44d1-87ff-0e8b34bbb855 service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-24f1ca4e-c020-43b2-b837-389ffe4d0f3d req-c02d0b99-abf6-44d1-87ff-0e8b34bbb855 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] No waiting events found dispatching network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:37 user nova-compute[74441]: WARNING nova.compute.manager [req-24f1ca4e-c020-43b2-b837-389ffe4d0f3d req-c02d0b99-abf6-44d1-87ff-0e8b34bbb855 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received unexpected event network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 for instance with vm_state building and task_state spawning.
Nov 09 00:58:37 user nova-compute[74441]: INFO nova.compute.manager [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Took 43.75 seconds to build instance.
Nov 09 00:58:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-82b3904c-6e6c-437b-9c7d-b5f6bc8662e8 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.863s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 00:58:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Creating image(s)
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Ensure instance console log exists: /opt/stack/data/nova/instances/53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Start _get_guest_xml network_info=[{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38', 'attached_at': '', 'detached_at': '', 'volume_id': 'c314dc54-4f09-43d1-9850-df397db83124', 'serial': 'c314dc54-4f09-43d1-9850-df397db83124'}, 'attachment_id': '7e9ebbfa-b8ee-408e-b0f8-45c4e8c8e9e5', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 00:58:50 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:50 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:58:50 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:50 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:58:50 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f013b9e2-f9ff-47ff-b1c3-e00c4c09c591]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 00:58:50 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4472b7ee-1f89-4cdf-aef0-cffc437982c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124] added
Nov 09 00:58:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4524fb-9107-482d-81e5-b79f38077799]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeefee1-b173-4330-886f-e0222106b944]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJuviVZH {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJuviVZH" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9676e575-7503-4974-af07-9bb0a3eb2791]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJuviVZH'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b277673-2ec6-4d3e-92c6-685caf3a1a84]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[639f6457-6f58-497c-b218-4df63cc6bf9f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1719f5d-bea9-4448-9951-53b0657cf04e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]
Nov 09 00:58:50 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.
Nov 09 00:58:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9380ee-fb40-44f3-a15b-c4ce1c9effc8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b88535-547d-490b-97df-d80407c697f3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 00:58:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deb711f-541c-481e-938c-f708895cd4a6]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 00:58:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26633323765616237', 'path': '/dev/sdf'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633323765616237', 'path': '/dev/sdf'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1396576025',display_name='tempest-ServerActionsTestOtherA-server-1396576025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1396576025',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-nndelj3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.objects.instance [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'pci_devices' on Instance uuid 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] End _get_guest_xml xml=<domain type="kvm">
Nov 09 00:58:51 user nova-compute[74441]:   <uuid>53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38</uuid>
Nov 09 00:58:51 user nova-compute[74441]:   <name>instance-00000020</name>
Nov 09 00:58:51 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 00:58:51 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 00:58:51 user nova-compute[74441]:   <metadata>
Nov 09 00:58:51 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 00:58:51 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 00:58:51 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherA-server-1396576025</nova:name>
Nov 09 00:58:51 user nova-compute[74441]:       <nova:creationTime>2023-11-09 00:58:50</nova:creationTime>
Nov 09 00:58:51 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 00:58:51 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 00:58:51 user nova-compute[74441]:       </nova:flavor>
Nov 09 00:58:51 user nova-compute[74441]:       <nova:owner>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:user uuid="dee4ca1b1a8d432d943ba7bf20f41f1b">tempest-ServerActionsTestOtherA-1357980906-project-member</nova:user>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:project uuid="24c24e7fc6e24dd0bc5c8ca3bfd1166f">tempest-ServerActionsTestOtherA-1357980906</nova:project>
Nov 09 00:58:51 user nova-compute[74441]:       </nova:owner>
Nov 09 00:58:51 user nova-compute[74441]:       <nova:ports>
Nov 09 00:58:51 user nova-compute[74441]:         <nova:port uuid="56411d66-37db-4073-959a-01c9c64508e9">
Nov 09 00:58:51 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 00:58:51 user nova-compute[74441]:         </nova:port>
Nov 09 00:58:51 user nova-compute[74441]:       </nova:ports>
Nov 09 00:58:51 user nova-compute[74441]:     </nova:instance>
Nov 09 00:58:51 user nova-compute[74441]:   </metadata>
Nov 09 00:58:51 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 00:58:51 user nova-compute[74441]:     <system>
Nov 09 00:58:51 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 00:58:51 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 00:58:51 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 00:58:51 user nova-compute[74441]:       <entry name="serial">53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38</entry>
Nov 09 00:58:51 user nova-compute[74441]:       <entry name="uuid">53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38</entry>
Nov 09 00:58:51 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 00:58:51 user nova-compute[74441]:     </system>
Nov 09 00:58:51 user nova-compute[74441]:   </sysinfo>
Nov 09 00:58:51 user nova-compute[74441]:   <os>
Nov 09 00:58:51 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 00:58:51 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 00:58:51 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 00:58:51 user nova-compute[74441]:   </os>
Nov 09 00:58:51 user nova-compute[74441]:   <features>
Nov 09 00:58:51 user nova-compute[74441]:     <acpi/>
Nov 09 00:58:51 user nova-compute[74441]:     <apic/>
Nov 09 00:58:51 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 00:58:51 user nova-compute[74441]:   </features>
Nov 09 00:58:51 user nova-compute[74441]:   <clock offset="utc">
Nov 09 00:58:51 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 00:58:51 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 00:58:51 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 00:58:51 user nova-compute[74441]:   </clock>
Nov 09 00:58:51 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 00:58:51 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 00:58:51 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 00:58:51 user nova-compute[74441]:   </cpu>
Nov 09 00:58:51 user nova-compute[74441]:   <devices>
Nov 09 00:58:51 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 00:58:51 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 00:58:51 user nova-compute[74441]:       <source dev="/dev/sdf"/>
Nov 09 00:58:51 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 00:58:51 user nova-compute[74441]:       <serial>c314dc54-4f09-43d1-9850-df397db83124</serial>
Nov 09 00:58:51 user nova-compute[74441]:     </disk>
Nov 09 00:58:51 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 00:58:51 user nova-compute[74441]:       <mac address="fa:16:3e:f1:f8:8c"/>
Nov 09 00:58:51 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:51 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 00:58:51 user nova-compute[74441]:       <target dev="tap56411d66-37"/>
Nov 09 00:58:51 user nova-compute[74441]:     </interface>
Nov 09 00:58:51 user nova-compute[74441]:     <serial type="pty">
Nov 09 00:58:51 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38/console.log" append="off"/>
Nov 09 00:58:51 user nova-compute[74441]:     </serial>
Nov 09 00:58:51 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 00:58:51 user nova-compute[74441]:     <video>
Nov 09 00:58:51 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 00:58:51 user nova-compute[74441]:     </video>
Nov 09 00:58:51 user nova-compute[74441]:     <rng model="virtio">
Nov 09 00:58:51 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 00:58:51 user nova-compute[74441]:     </rng>
Nov 09 00:58:51 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 00:58:51 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 00:58:51 user nova-compute[74441]:       <stats period="10"/>
Nov 09 00:58:51 user nova-compute[74441]:     </memballoon>
Nov 09 00:58:51 user nova-compute[74441]:   </devices>
Nov 09 00:58:51 user nova-compute[74441]: </domain>
Nov 09 00:58:51 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1396576025',display_name='tempest-ServerActionsTestOtherA-server-1396576025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1396576025',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-nndelj3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T00:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG os_vif [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e3cea96-682e-5b14-a218-46d2254322f5', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56411d66-37, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56411d66-37, col_values=(('qos', UUID('2e3ffd5a-9a8c-4455-abea-0f0b387e52ea')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56411d66-37, col_values=(('external_ids', {'iface-id': '56411d66-37db-4073-959a-01c9c64508e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:f8:8c', 'vm-uuid': '53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:51 user nova-compute[74441]: INFO os_vif [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37')
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 00:58:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No VIF found with MAC fa:16:3e:f1:f8:8c, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-51adc4fd-3b49-4baa-a700-67a1721fc08a req-605b7fe0-c1df-4651-96e7-4cf10ee46243 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-51adc4fd-3b49-4baa-a700-67a1721fc08a req-605b7fe0-c1df-4651-96e7-4cf10ee46243 service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-51adc4fd-3b49-4baa-a700-67a1721fc08a req-605b7fe0-c1df-4651-96e7-4cf10ee46243 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-51adc4fd-3b49-4baa-a700-67a1721fc08a req-605b7fe0-c1df-4651-96e7-4cf10ee46243 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-51adc4fd-3b49-4baa-a700-67a1721fc08a req-605b7fe0-c1df-4651-96e7-4cf10ee46243 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:53 user nova-compute[74441]: WARNING nova.compute.manager [req-51adc4fd-3b49-4baa-a700-67a1721fc08a req-605b7fe0-c1df-4651-96e7-4cf10ee46243 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state building and task_state spawning.
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 00:58:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance spawned successfully.
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 00:58:55 user nova-compute[74441]: INFO nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-5d8e86f0-12ec-47fd-b68e-6a6fd04e10a9 req-0a024328-7b9d-4ce7-ad28-7fe049f4fb3e service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5d8e86f0-12ec-47fd-b68e-6a6fd04e10a9 req-0a024328-7b9d-4ce7-ad28-7fe049f4fb3e service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5d8e86f0-12ec-47fd-b68e-6a6fd04e10a9 req-0a024328-7b9d-4ce7-ad28-7fe049f4fb3e service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5d8e86f0-12ec-47fd-b68e-6a6fd04e10a9 req-0a024328-7b9d-4ce7-ad28-7fe049f4fb3e service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-5d8e86f0-12ec-47fd-b68e-6a6fd04e10a9 req-0a024328-7b9d-4ce7-ad28-7fe049f4fb3e service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:58:55 user nova-compute[74441]: WARNING nova.compute.manager [req-5d8e86f0-12ec-47fd-b68e-6a6fd04e10a9 req-0a024328-7b9d-4ce7-ad28-7fe049f4fb3e service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state building and task_state spawning.
Nov 09 00:58:55 user nova-compute[74441]: INFO nova.compute.manager [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Took 31.11 seconds to build instance.
Nov 09 00:58:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7603d298-45ff-4d3b-907f-460d47de4fa1 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.257s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:58:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:58:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 00:58:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:58:59 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:59:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:08 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:59:08 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 00:59:08 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7391MB free_disk=24.894912719726562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance eaba06fc-d11e-458c-b7b5-1f8681768586 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance a1a0ef75-791d-4e14-bc0d-65471b48e4ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 00:59:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 00:59:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 00:59:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:20 user nova-compute[74441]: INFO nova.compute.manager [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Unrescuing
Nov 09 00:59:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:59:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:59:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'flavor' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-226b9d94-c3d8-4e89-9ecc-b9beb01f316a req-ec35309d-39d7-44fa-a4d1-fa37466d8fba service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-226b9d94-c3d8-4e89-9ecc-b9beb01f316a req-ec35309d-39d7-44fa-a4d1-fa37466d8fba service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-226b9d94-c3d8-4e89-9ecc-b9beb01f316a req-ec35309d-39d7-44fa-a4d1-fa37466d8fba service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-226b9d94-c3d8-4e89-9ecc-b9beb01f316a req-ec35309d-39d7-44fa-a4d1-fa37466d8fba service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-226b9d94-c3d8-4e89-9ecc-b9beb01f316a req-ec35309d-39d7-44fa-a4d1-fa37466d8fba service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:59:21 user nova-compute[74441]: WARNING nova.compute.manager [req-226b9d94-c3d8-4e89-9ecc-b9beb01f316a req-ec35309d-39d7-44fa-a4d1-fa37466d8fba service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:59:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance destroyed successfully.
Nov 09 00:59:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:59:23 user nova-compute[74441]: WARNING nova.compute.manager [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:59:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:59:23 user nova-compute[74441]: WARNING nova.compute.manager [req-1cfff119-1430-4282-af15-56ed2b7ea678 req-18184cf2-6beb-4f5a-a5cd-01cb1cac292f service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:59:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:59:24 user nova-compute[74441]: INFO nova.compute.manager [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] instance snapshotting
Nov 09 00:59:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Beginning live snapshot process
Nov 09 00:59:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5zgqz2eo/3b278fcc51d94630ab0cc191e4ee2413.delta 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5zgqz2eo/3b278fcc51d94630ab0cc191e4ee2413.delta 1073741824" returned: 0 in 0.055s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 00:59:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-43bdb2ea-6c82-46b9-8139-287ac12ceaee tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-88c34e54-a808-49a3-9b71-35b4bdb5fcbc req-ac411941-2954-4c74-90ed-ccfb876c0fdf service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88c34e54-a808-49a3-9b71-35b4bdb5fcbc req-ac411941-2954-4c74-90ed-ccfb876c0fdf service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88c34e54-a808-49a3-9b71-35b4bdb5fcbc req-ac411941-2954-4c74-90ed-ccfb876c0fdf service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88c34e54-a808-49a3-9b71-35b4bdb5fcbc req-ac411941-2954-4c74-90ed-ccfb876c0fdf service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-88c34e54-a808-49a3-9b71-35b4bdb5fcbc req-ac411941-2954-4c74-90ed-ccfb876c0fdf service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:59:25 user nova-compute[74441]: WARNING nova.compute.manager [req-88c34e54-a808-49a3-9b71-35b4bdb5fcbc req-ac411941-2954-4c74-90ed-ccfb876c0fdf service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state rescued and task_state unrescuing.
Nov 09 00:59:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 00:59:26 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 00:59:26 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 00:59:26 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 00:59:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5zgqz2eo/3b278fcc51d94630ab0cc191e4ee2413.delta /opt/stack/data/nova/instances/snapshots/tmp5zgqz2eo/3b278fcc51d94630ab0cc191e4ee2413 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5zgqz2eo/3b278fcc51d94630ab0cc191e4ee2413.delta /opt/stack/data/nova/instances/snapshots/tmp5zgqz2eo/3b278fcc51d94630ab0cc191e4ee2413" returned: 0 in 0.443s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:26 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Snapshot extracted, beginning image upload
Nov 09 00:59:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Snapshot image upload complete
Nov 09 00:59:29 user nova-compute[74441]: INFO nova.compute.manager [None req-c015370a-c61d-4dca-a4f5-8f0767c882ea tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Took 5.23 seconds to snapshot the instance on the hypervisor.
Nov 09 00:59:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-changed-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Refreshing instance network info cache due to event network-changed-fbce1843-c995-458c-a094-e46838e22a25. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] Acquiring lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] Acquired lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Refreshing network info cache for port fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updated VIF entry in instance network info cache for port fbce1843-c995-458c-a094-e46838e22a25. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating instance_info_cache with network_info: [{"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6f61fc28-5e60-4bbb-b1b1-ee648b5901d4 req-b690fac0-b6dc-42bf-ab7a-6ae7482da02a service nova] Releasing lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:59:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:59:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:59:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:42 user nova-compute[74441]: INFO nova.compute.manager [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attaching volume aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 to /dev/vdb
Nov 09 00:59:43 user nova-compute[74441]: DEBUG os_brick.utils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d59845-b9a9-485e-9ed4-ef1135d00490]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c99e30-9381-4482-b2f6-df80c70035db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5055b78-9fb0-4ce9-b40d-8c7b293e5bbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bdf819-6aac-481f-8d49-19b582153ff2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 00:59:43 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 00:59:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16fdfc-bafa-402a-9086-fbe4210a731f]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG os_brick.utils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:59:43 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating existing volume attachment record: 397d81d9-6677-4650-9a1c-b9b8d97ae0b1 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:44 user nova-compute[74441]: INFO nova.compute.manager [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Terminating instance
Nov 09 00:59:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-b80f3330-6d55-4873-a634-c563ef5c5952 req-eff57d19-27ea-4614-9273-233f3fff43ca service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-vif-unplugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b80f3330-6d55-4873-a634-c563ef5c5952 req-eff57d19-27ea-4614-9273-233f3fff43ca service nova] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b80f3330-6d55-4873-a634-c563ef5c5952 req-eff57d19-27ea-4614-9273-233f3fff43ca service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b80f3330-6d55-4873-a634-c563ef5c5952 req-eff57d19-27ea-4614-9273-233f3fff43ca service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-b80f3330-6d55-4873-a634-c563ef5c5952 req-eff57d19-27ea-4614-9273-233f3fff43ca service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] No waiting events found dispatching network-vif-unplugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:59:44 user nova-compute[74441]: DEBUG nova.compute.manager [req-b80f3330-6d55-4873-a634-c563ef5c5952 req-eff57d19-27ea-4614-9273-233f3fff43ca service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-vif-unplugged-a8522639-221b-4f46-805b-26c2f2b10dc9 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Instance destroyed successfully.
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'resources' on Instance uuid eaba06fc-d11e-458c-b7b5-1f8681768586 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-22445469',display_name='tempest-TestVolumeBootPattern-server-22445469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-22445469',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-3savn378',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:58:38Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=eaba06fc-d11e-458c-b7b5-1f8681768586,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "a8522639-221b-4f46-805b-26c2f2b10dc9", "address": "fa:16:3e:18:14:bc", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8522639-22", "ovs_interfaceid": "a8522639-221b-4f46-805b-26c2f2b10dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_vif [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8522639-22, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a29ce311-6f02-4a33-9c9c-3444a66e95a1) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 00:59:45 user nova-compute[74441]: INFO os_vif [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:14:bc,bridge_name='br-int',has_traffic_filtering=True,id=a8522639-221b-4f46-805b-26c2f2b10dc9,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8522639-22')
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkAViWcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 00:59:45 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef130db1-eb75-4b13-976b-8937c0f741d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 00:59:45 user nova-compute[74441]: No targets found.
Nov 09 00:59:45 user nova-compute[74441]: iSNS:
Nov 09 00:59:45 user nova-compute[74441]: No targets found.
Nov 09 00:59:45 user nova-compute[74441]: STATIC:
Nov 09 00:59:45 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0
Nov 09 00:59:45 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:59:45 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:59:45 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 00:59:45 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:59:45 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:59:45 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2
Nov 09 00:59:45 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:59:45 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:59:45 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 00:59:45 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:59:45 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:59:45 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9
Nov 09 00:59:45 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 00:59:45 user nova-compute[74441]:                 Iface Name: default
Nov 09 00:59:45 user nova-compute[74441]: FIRMWARE:
Nov 09 00:59:45 user nova-compute[74441]: No targets found.
Nov 09 00:59:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 00:59:45 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 00:59:45 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[19106b29-3b66-4965-8f8d-d8cd55736b3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4918fc3-42d0-499c-a08a-38a72230b2c2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 00:59:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c138dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0'): ({'sde'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Removing single pathed devices sde {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[08340a36-aea5-4264-b871-7e4b06b39b71]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d8b763-ca3d-4577-a4bc-a8eee93e7a60]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flushing IO for device /dev/sde {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67e922-703f-48ec-a7de-c82883508e3d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f497b11-c4cb-4cda-886c-28f0c4c16854]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc4001244-b31a20335accb8bd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c4001244', '/dev/disk/by-id/scsi-26233316132303333') {{(pid=85292) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e868b750-591c-4791-a7de-1e1486311e2a]: (4, None) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[914f0ce8-2403-447f-975c-98aca65f4c5d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[515d9b7f-5407-46d6-9ae7-c7e74e120b3c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260]
Nov 09 00:59:45 user nova-compute[74441]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0, portal: 172.16.0.220,3260] successful.
Nov 09 00:59:45 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:358ae73b-8502-42bc-be3b-a6232592b9b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7c682-742e-4968-850d-90ddb52b5e1a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== disconnect_volume: return (314ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 00:59:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Deleting instance files /opt/stack/data/nova/instances/eaba06fc-d11e-458c-b7b5-1f8681768586_del
Nov 09 00:59:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Deletion of /opt/stack/data/nova/instances/eaba06fc-d11e-458c-b7b5-1f8681768586_del complete
Nov 09 00:59:45 user nova-compute[74441]: INFO nova.compute.manager [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 09 00:59:45 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 00:59:45 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 00:59:46 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:59:46 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Took 0.59 seconds to deallocate network for instance.
Nov 09 00:59:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] Acquiring lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] No waiting events found dispatching network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 00:59:46 user nova-compute[74441]: WARNING nova.compute.manager [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received unexpected event network-vif-plugged-a8522639-221b-4f46-805b-26c2f2b10dc9 for instance with vm_state active and task_state deleting.
Nov 09 00:59:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-65ac09b3-b5b3-4f15-be61-439199a3615e req-71b88eed-1bbb-4a40-a094-bdb1b6ab9333 service nova] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Received event network-vif-deleted-a8522639-221b-4f46-805b-26c2f2b10dc9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 00:59:47 user nova-compute[74441]: INFO nova.compute.manager [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Took 0.91 seconds to detach 1 volumes for instance.
Nov 09 00:59:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: eaba06fc-d11e-458c-b7b5-1f8681768586] Deleting volume: 358ae73b-8502-42bc-be3b-a6232592b9b0 {{(pid=74441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 00:59:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 00:59:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 00:59:48 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 00:59:48 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 00:59:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:48 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Deleted allocations for instance eaba06fc-d11e-458c-b7b5-1f8681768586
Nov 09 00:59:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1dddbf5-1920-4f2f-bb3e-99e7b145bbee tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "eaba06fc-d11e-458c-b7b5-1f8681768586" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.639s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 00:59:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 00:59:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:00:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:00:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:00:05 user nova-compute[74441]: INFO nova.compute.manager [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Unrescuing
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'flavor' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-08d456dc-c387-4e3e-bea0-973bb16697d6 req-b7288a26-e360-48af-9150-bf6017ca767e service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-08d456dc-c387-4e3e-bea0-973bb16697d6 req-b7288a26-e360-48af-9150-bf6017ca767e service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-08d456dc-c387-4e3e-bea0-973bb16697d6 req-b7288a26-e360-48af-9150-bf6017ca767e service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-08d456dc-c387-4e3e-bea0-973bb16697d6 req-b7288a26-e360-48af-9150-bf6017ca767e service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-08d456dc-c387-4e3e-bea0-973bb16697d6 req-b7288a26-e360-48af-9150-bf6017ca767e service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:06 user nova-compute[74441]: WARNING nova.compute.manager [req-08d456dc-c387-4e3e-bea0-973bb16697d6 req-b7288a26-e360-48af-9150-bf6017ca767e service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:06 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance destroyed successfully.
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-changed-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Refreshing instance network info cache due to event network-changed-05a926f9-c876-4177-a58d-8a603a619d10. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] Acquiring lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] Acquired lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Refreshing network info cache for port 05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing instance network info cache due to event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:07 user nova-compute[74441]: INFO nova.compute.manager [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Terminating instance
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updated VIF entry in instance network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c80ca1ea-e094-4cec-9391-d7f65422ab53 req-2848fa6a-f26e-450a-9b80-51f212adf9cd service nova] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Updated VIF entry in instance network info cache for port 05a926f9-c876-4177-a58d-8a603a619d10. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Updating instance_info_cache with network_info: [{"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b1ed0564-338b-463a-b6ed-8e091533fec6 req-842bdd6e-0e9e-42dd-8309-be10cc500043 service nova] Releasing lock "refresh_cache-a1a0ef75-791d-4e14-bc0d-65471b48e4ca" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING nova.compute.manager [req-d85cfcc8-94c3-4dc7-a44f-06be9edbf58f req-9f3c7c21-5a15-49fb-889a-e55b1a2e094b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGTqfBbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:00:08 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:00:08 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec908d-b221-4726-a75c-55e96f4d5fd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:00:08 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f92bb3-3e2a-49a8-a1d8-bbafdf7c6c2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1] added
Nov 09 01:00:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3cf75b-dc3d-4326-9418-fc25d2a9053e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390dbdf-c69a-425e-bad8-515676d45b58]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGTqfBbt {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGTqfBbt" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13b389-6f49-4927-b153-334e74546318]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGTqfBbt'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d061f7-b871-48f5-b3c2-afd1e6870073]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c4aa6-4569-41ee-8423-35ad6e0e08d1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Instance destroyed successfully.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'resources' on Instance uuid a1a0ef75-791d-4e14-bc0d-65471b48e4ca {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-857411949',display_name='tempest-AttachVolumeNegativeTest-server-857411949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-857411949',id=31,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZj7v45fnFHoySqDYenafSOob1rt6//M6Gm8Zx/E42TkiTdRkiGuhZeG5Pz7smisjeW1ReMfHK5DHFyQagWLKfC8d4R0Ar5UaMPpfcr/yOFkYkyh2XZV9nZ69tEJN2mOQ==',key_name='tempest-keypair-1859582499',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-9br3ro3x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:58:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=a1a0ef75-791d-4e14-bc0d-65471b48e4ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "05a926f9-c876-4177-a58d-8a603a619d10", "address": "fa:16:3e:89:01:f8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05a926f9-c8", "ovs_interfaceid": "05a926f9-c876-4177-a58d-8a603a619d10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_vif [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05a926f9-c8, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ded1f5e-5855-47f2-b6f5-fe71b9367e03) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: INFO os_vif [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:01:f8,bridge_name='br-int',has_traffic_filtering=True,id=05a926f9-c876-4177-a58d-8a603a619d10,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05a926f9-c8')
Nov 09 01:00:08 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Deleting instance files /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca_del
Nov 09 01:00:08 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Deletion of /opt/stack/data/nova/instances/a1a0ef75-791d-4e14-bc0d-65471b48e4ca_del complete
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc251155-2fff-4af0-9533-c8f85cf5e9e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260]
Nov 09 01:00:08 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260] successful.
Nov 09 01:00:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e8cd7-1dce-4bdc-8664-4f9bba60cc5c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e4f00b-ad99-4cfa-9b76-4725990b89b8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:08 user nova-compute[74441]: INFO nova.compute.manager [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 09 01:00:08 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:00:08 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54fc37e-c314-488c-bd35-721a2be9b3ac]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGTqfBbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-vif-unplugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] No waiting events found dispatching network-vif-unplugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-vif-unplugged-05a926f9-c876-4177-a58d-8a603a619d10 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] Acquiring lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] No waiting events found dispatching network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:09 user nova-compute[74441]: WARNING nova.compute.manager [req-5209b428-ee15-4b2d-9d93-aba2bd3d694c req-a8b7a6b2-5918-45aa-bacd-152cf7bd3a25 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received unexpected event network-vif-plugged-05a926f9-c876-4177-a58d-8a603a619d10 for instance with vm_state active and task_state deleting.
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing instance network info cache due to event network-changed-494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] Acquiring lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] Acquired lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.network.neutron [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Refreshing network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.network.neutron [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updated VIF entry in instance network info cache for port 494268cb-cba1-478a-a7a2-7657f2134dd5. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.network.neutron [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [{"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5d91842a-a96f-4486-81ea-67fabef32b09 req-45e645b3-0083-4985-974a-c9e7930b9f1b service nova] Releasing lock "refresh_cache-b2c005b6-7adc-45e8-8539-8fd4306051d3" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:09 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Took 0.85 seconds to deallocate network for instance.
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23564393165386234', 'path': '/dev/sde'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564393165386234', 'path': '/dev/sde'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.objects.instance [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:00:10 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:10 user nova-compute[74441]:   <source dev="/dev/sde"/>
Nov 09 01:00:10 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:10 user nova-compute[74441]:   <serial>aee7a7ab-f65c-4aff-9b18-18ee651a1ec1</serial>
Nov 09 01:00:10 user nova-compute[74441]: </disk>
Nov 09 01:00:10 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:10 user nova-compute[74441]: WARNING nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:10 user nova-compute[74441]: WARNING nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-73ce7c70-5fa1-4586-a6c1-75945030007c req-748f9588-431f-43d4-91ba-38b15e9423d1 service nova] [instance: a1a0ef75-791d-4e14-bc0d-65471b48e4ca] Received event network-vif-deleted-05a926f9-c876-4177-a58d-8a603a619d10 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No VIF found with MAC fa:16:3e:45:27:b1, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.796s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:10 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Deleted allocations for instance a1a0ef75-791d-4e14-bc0d-65471b48e4ca
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-59bb12fd-a344-44db-8094-187673ab9467 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd65aa8a-a9f7-44e0-b056-4e4ecf382d3b tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.821s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4ead38e3-3d91-4ab7-8632-a7cba10337b0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "a1a0ef75-791d-4e14-bc0d-65471b48e4ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.394s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:00:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:11 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:00:11 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7575MB free_disk=24.836124420166016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:00:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:00:12 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:00:12 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:00:12 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:00:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-changed-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Refreshing instance network info cache due to event network-changed-184a62e0-be26-4fff-a8f4-927393e2f732. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG nova.network.neutron [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Refreshing network info cache for port 184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG nova.network.neutron [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updated VIF entry in instance network info cache for port 184a62e0-be26-4fff-a8f4-927393e2f732. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG nova.network.neutron [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-aa96f690-508d-4868-b8df-47d80bcc6e4e req-6b66556a-9772-4a6f-9f4f-074b0ed8bb21 service nova] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Stashing vm_state: active {{(pid=74441) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 09 01:00:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:00:16 user nova-compute[74441]: INFO nova.compute.claims [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Claim successful on node user
Nov 09 01:00:17 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating resource usage from migration 196f0abf-191e-4615-9a65-91d91852bc39
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.443s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:17 user nova-compute[74441]: INFO nova.compute.manager [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Migrating
Nov 09 01:00:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquired lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-changed-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Refreshing instance network info cache due to event network-changed-56411d66-37db-4073-959a-01c9c64508e9. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] Acquiring lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.network.neutron [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Releasing lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] Acquired lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Refreshing network info cache for port 56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Starting migrate_disk_and_power_off {{(pid=74441) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance destroyed successfully.
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1396576025',display_name='tempest-ServerActionsTestOtherA-server-1396576025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1396576025',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-nndelj3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56411d66-37, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e3ffd5a-9a8c-4455-abea-0f0b387e52ea) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:18 user nova-compute[74441]: INFO os_vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37')
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:00:18 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updated VIF entry in instance network info cache for port 56411d66-37db-4073-959a-01c9c64508e9. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG nova.network.neutron [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea8e3e6-5d65-4bf5-ab9c-c9a2c31b3413]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:00:18 user nova-compute[74441]: No targets found.
Nov 09 01:00:18 user nova-compute[74441]: iSNS:
Nov 09 01:00:18 user nova-compute[74441]: No targets found.
Nov 09 01:00:18 user nova-compute[74441]: STATIC:
Nov 09 01:00:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:00:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1
Nov 09 01:00:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2
Nov 09 01:00:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 01:00:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:18 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9
Nov 09 01:00:18 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:18 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:18 user nova-compute[74441]: FIRMWARE:
Nov 09 01:00:18 user nova-compute[74441]: No targets found.
Nov 09 01:00:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:00:18 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:00:18 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bce49253-d10b-41c7-9a16-38767d3d981c req-0d1f4b68-a2fb-4c1c-a05c-0788d9f84d57 service nova] Releasing lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4037a675-deaf-4932-a99c-559a92aeed32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d5502-f7d0-485c-a901-87a58a8158c0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c55f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124'): ({'sdf'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Removing single pathed devices sdf {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd19af-5ee5-4c8d-924b-1048394b8be2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958ec6d-1ba7-4754-b901-ba1b3e6aa8a1]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flushing IO for device /dev/sdf {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cc6967-7b3b-4a5b-aee8-4cc12d07d6df]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:00:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80b3aa-b9c3-477b-bbb4-c57225037dc8]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26633323765616237', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dffb92c4', '/dev/disk/by-id/scsi-1SCST_BIOdffb92c4-f327eab7b5162c24') {{(pid=85292) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e6cf24-3fd6-4cdd-8d36-b7d9b29e323f]: (4, None) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a35e4f9-913b-4936-96e6-95fb84df9e7d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa36e4d-f7e3-4f6d-873c-72e4de26d5b6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]
Nov 09 01:00:19 user nova-compute[74441]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.
Nov 09 01:00:19 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[615a8e94-6887-4142-af53-c9421f0689fe]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== disconnect_volume: return (364ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-unplugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-unplugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:19 user nova-compute[74441]: WARNING nova.compute.manager [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-unplugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state active and task_state resize_migrating.
Nov 09 01:00:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:19 user nova-compute[74441]: WARNING nova.compute.manager [req-fe805de9-dd73-4385-997c-b0fc1754e29a req-06b2ed41-a92c-4fa8-865e-b96f33656742 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state active and task_state resize_migrating.
Nov 09 01:00:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Port 56411d66-37db-4073-959a-01c9c64508e9 binding to destination host user is already ACTIVE {{(pid=74441) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 01:00:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquired lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Releasing lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG os_brick.utils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c501da7-9eff-4fb7-997b-36a7ce65abe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdac228-767c-4bf2-aed1-d8b28be3d83e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b648a94e-5943-44bb-b28d-338dde631b81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf2d8d6-190d-41b7-8221-16b19e9077a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:00:21 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:00:21 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99561b9-6be4-4395-bc5e-1e1a9add4770]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:00:21 user nova-compute[74441]: DEBUG os_brick.utils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:00:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:00:32 user nova-compute[74441]: INFO nova.compute.claims [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Claim successful on node user
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:00:32 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:00:32 user nova-compute[74441]: DEBUG nova.policy [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffa1084de0be460fa924e3f124e47a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf77bd26a3e4bb1831823704242a3b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:00:32 user nova-compute[74441]: INFO nova.virt.block_device [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Booting with blank volume at /dev/vda
Nov 09 01:00:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:33 user nova-compute[74441]: DEBUG nova.network.neutron [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Successfully created port: add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:00:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Successfully updated port: add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquired lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-changed-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Refreshing instance network info cache due to event network-changed-add2e353-4f48-4a42-8eee-955da3ff6b11. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] Acquiring lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Releasing lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance network_info: |[{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] Acquired lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Refreshing network info cache for port add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updated VIF entry in instance network info cache for port add2e353-4f48-4a42-8eee-955da3ff6b11. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-03436bc6-d6ef-4052-9df8-2fb1a21b9177 req-d71bd0da-9192-46d4-82a2-077acfe604bc service nova] Releasing lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:38 user nova-compute[74441]: INFO nova.compute.manager [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Detaching volume fec3dc9a-166b-4b6c-80af-c63ec20058b9
Nov 09 01:00:39 user nova-compute[74441]: INFO nova.virt.block_device [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Attempting to driver detach volume fec3dc9a-166b-4b6c-80af-c63ec20058b9 from mountpoint /dev/vdb
Nov 09 01:00:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Attempting to detach device vdb from instance b2c005b6-7adc-45e8-8539-8fd4306051d3 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:00:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:00:39 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:39 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:00:39 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:39 user nova-compute[74441]:   <serial>fec3dc9a-166b-4b6c-80af-c63ec20058b9</serial>
Nov 09 01:00:39 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:00:39 user nova-compute[74441]: </disk>
Nov 09 01:00:39 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:00:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Successfully detached device vdb from instance b2c005b6-7adc-45e8-8539-8fd4306051d3 from the persistent domain config.
Nov 09 01:00:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2c005b6-7adc-45e8-8539-8fd4306051d3 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:00:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:00:39 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:39 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:00:39 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:39 user nova-compute[74441]:   <serial>fec3dc9a-166b-4b6c-80af-c63ec20058b9</serial>
Nov 09 01:00:39 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:00:39 user nova-compute[74441]: </disk>
Nov 09 01:00:39 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:00:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:00:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:50 user nova-compute[74441]: INFO nova.compute.manager [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Detaching volume aee7a7ab-f65c-4aff-9b18-18ee651a1ec1
Nov 09 01:00:50 user nova-compute[74441]: INFO nova.virt.block_device [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attempting to driver detach volume aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 from mountpoint /dev/vdb
Nov 09 01:00:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Attempting to detach device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:00:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:00:50 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:50 user nova-compute[74441]:   <source dev="/dev/sde"/>
Nov 09 01:00:50 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:50 user nova-compute[74441]:   <serial>aee7a7ab-f65c-4aff-9b18-18ee651a1ec1</serial>
Nov 09 01:00:50 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:00:50 user nova-compute[74441]: </disk>
Nov 09 01:00:50 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:00:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config.
Nov 09 01:00:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:00:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:00:50 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:50 user nova-compute[74441]:   <source dev="/dev/sde"/>
Nov 09 01:00:50 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:50 user nova-compute[74441]:   <serial>aee7a7ab-f65c-4aff-9b18-18ee651a1ec1</serial>
Nov 09 01:00:50 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:00:50 user nova-compute[74441]: </disk>
Nov 09 01:00:50 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:00:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Starting finish_migration {{(pid=74441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 01:00:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Creating image(s)
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Ensure instance console log exists: /opt/stack/data/nova/instances/53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Start _get_guest_xml network_info=[{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38', 'attached_at': '2023-11-09T01:00:51.000000', 'detached_at': '', 'volume_id': 'c314dc54-4f09-43d1-9850-df397db83124', 'serial': 'c314dc54-4f09-43d1-9850-df397db83124'}, 'attachment_id': '4f9c1763-c57b-4778-a46d-87e024cd3407', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:00:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:00:51 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:34:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:00:51 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:00:51 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:00:51 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5072cd-456d-4b5e-8408-549d83f7fffb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:00:51 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b402fd-3d08-4e30-a287-507a1a92ba84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124] added
Nov 09 01:00:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0bd4b2-4289-442c-8de3-d553f31b20c0]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b24ca44-a6c4-4383-915f-98706366f433]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJuviVZH {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qJuviVZH" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353d2cb-ae45-4ed9-a90b-8da6ff31636f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qJuviVZH'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c9e530-4eaf-4762-91b8-b5087d2279e3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8556e012-7928-40fd-81c8-799d08e090c9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d51a4b-b45f-4aaf-bc6c-5e5208241520]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]
Nov 09 01:00:51 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.
Nov 09 01:00:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f4858-3bcd-496a-8a70-0f6d96c33c10]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4316e6-ae39-4615-b097-1155f3c6cad1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aac7cc-3e2c-427e-bc96-828eeb29aba3]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:00:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26633323765616237', 'path': '/dev/sdf'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633323765616237', 'path': '/dev/sdf'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1396576025',display_name='tempest-ServerActionsTestOtherA-server-1396576025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1396576025',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-nndelj3e',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:00:52 user nova-compute[74441]:   <uuid>53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38</uuid>
Nov 09 01:00:52 user nova-compute[74441]:   <name>instance-00000020</name>
Nov 09 01:00:52 user nova-compute[74441]:   <memory>2097152</memory>
Nov 09 01:00:52 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:00:52 user nova-compute[74441]:   <metadata>
Nov 09 01:00:52 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:00:52 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:00:52 user nova-compute[74441]:       <nova:name>tempest-ServerActionsTestOtherA-server-1396576025</nova:name>
Nov 09 01:00:52 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:00:51</nova:creationTime>
Nov 09 01:00:52 user nova-compute[74441]:       <nova:flavor name="m1.small">
Nov 09 01:00:52 user nova-compute[74441]:         <nova:memory>2048</nova:memory>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:disk>20</nova:disk>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:00:52 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:00:52 user nova-compute[74441]:       <nova:owner>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:user uuid="dee4ca1b1a8d432d943ba7bf20f41f1b">tempest-ServerActionsTestOtherA-1357980906-project-member</nova:user>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:project uuid="24c24e7fc6e24dd0bc5c8ca3bfd1166f">tempest-ServerActionsTestOtherA-1357980906</nova:project>
Nov 09 01:00:52 user nova-compute[74441]:       </nova:owner>
Nov 09 01:00:52 user nova-compute[74441]:       <nova:ports>
Nov 09 01:00:52 user nova-compute[74441]:         <nova:port uuid="56411d66-37db-4073-959a-01c9c64508e9">
Nov 09 01:00:52 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 01:00:52 user nova-compute[74441]:         </nova:port>
Nov 09 01:00:52 user nova-compute[74441]:       </nova:ports>
Nov 09 01:00:52 user nova-compute[74441]:     </nova:instance>
Nov 09 01:00:52 user nova-compute[74441]:   </metadata>
Nov 09 01:00:52 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:00:52 user nova-compute[74441]:     <system>
Nov 09 01:00:52 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:00:52 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:00:52 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:00:52 user nova-compute[74441]:       <entry name="serial">53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38</entry>
Nov 09 01:00:52 user nova-compute[74441]:       <entry name="uuid">53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38</entry>
Nov 09 01:00:52 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:00:52 user nova-compute[74441]:     </system>
Nov 09 01:00:52 user nova-compute[74441]:   </sysinfo>
Nov 09 01:00:52 user nova-compute[74441]:   <os>
Nov 09 01:00:52 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:00:52 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:00:52 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:00:52 user nova-compute[74441]:   </os>
Nov 09 01:00:52 user nova-compute[74441]:   <features>
Nov 09 01:00:52 user nova-compute[74441]:     <acpi/>
Nov 09 01:00:52 user nova-compute[74441]:     <apic/>
Nov 09 01:00:52 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:00:52 user nova-compute[74441]:   </features>
Nov 09 01:00:52 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:00:52 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:00:52 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:00:52 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:00:52 user nova-compute[74441]:   </clock>
Nov 09 01:00:52 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:00:52 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:00:52 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:00:52 user nova-compute[74441]:   </cpu>
Nov 09 01:00:52 user nova-compute[74441]:   <devices>
Nov 09 01:00:52 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:00:52 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:52 user nova-compute[74441]:       <source dev="/dev/sdf"/>
Nov 09 01:00:52 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:00:52 user nova-compute[74441]:       <serial>c314dc54-4f09-43d1-9850-df397db83124</serial>
Nov 09 01:00:52 user nova-compute[74441]:     </disk>
Nov 09 01:00:52 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:00:52 user nova-compute[74441]:       <mac address="fa:16:3e:f1:f8:8c"/>
Nov 09 01:00:52 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:00:52 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:00:52 user nova-compute[74441]:       <target dev="tap56411d66-37"/>
Nov 09 01:00:52 user nova-compute[74441]:     </interface>
Nov 09 01:00:52 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:00:52 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38/console.log" append="off"/>
Nov 09 01:00:52 user nova-compute[74441]:     </serial>
Nov 09 01:00:52 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:00:52 user nova-compute[74441]:     <video>
Nov 09 01:00:52 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:00:52 user nova-compute[74441]:     </video>
Nov 09 01:00:52 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:00:52 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:00:52 user nova-compute[74441]:     </rng>
Nov 09 01:00:52 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:00:52 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:00:52 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:00:52 user nova-compute[74441]:     </memballoon>
Nov 09 01:00:52 user nova-compute[74441]:   </devices>
Nov 09 01:00:52 user nova-compute[74441]: </domain>
Nov 09 01:00:52 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1396576025',display_name='tempest-ServerActionsTestOtherA-server-1396576025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1396576025',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-nndelj3e',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1937024632-network", "vif_mac": "fa:16:3e:f1:f8:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG os_vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e3cea96-682e-5b14-a218-46d2254322f5', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56411d66-37, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56411d66-37, col_values=(('qos', UUID('3a340e02-faf6-4f7d-8401-ae01d0d5148e')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56411d66-37, col_values=(('external_ids', {'iface-id': '56411d66-37db-4073-959a-01c9c64508e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:f8:8c', 'vm-uuid': '53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:52 user nova-compute[74441]: INFO os_vif [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37')
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:00:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] No VIF found with MAC fa:16:3e:f1:f8:8c, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82cefa5-b166-42be-94e9-d3a901d5a18e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8971c204-67d5-4b39-bd13-d08347286bb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a31dcb-92e3-49dd-98e7-96043bdcfaad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e4e6d-e53a-411f-a8a1-66cd15d0f482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:00:53 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:00:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879cd70-14da-4056-b2ba-fecf53604604]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:00:53 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating existing volume attachment record: 021c4fe1-1291-479a-8e77-330f6267a062 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a79232e-4dc9-4531-932e-16804304ef97 req-537c84ad-75c1-49df-b001-703b40ec786d service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a79232e-4dc9-4531-932e-16804304ef97 req-537c84ad-75c1-49df-b001-703b40ec786d service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a79232e-4dc9-4531-932e-16804304ef97 req-537c84ad-75c1-49df-b001-703b40ec786d service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3a79232e-4dc9-4531-932e-16804304ef97 req-537c84ad-75c1-49df-b001-703b40ec786d service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG nova.compute.manager [req-3a79232e-4dc9-4531-932e-16804304ef97 req-537c84ad-75c1-49df-b001-703b40ec786d service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:54 user nova-compute[74441]: WARNING nova.compute.manager [req-3a79232e-4dc9-4531-932e-16804304ef97 req-537c84ad-75c1-49df-b001-703b40ec786d service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state active and task_state resize_finish.
Nov 09 01:00:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG nova.compute.manager [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:00:56 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance running successfully.
Nov 09 01:00:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Failed to set time: agent not configured {{(pid=74441) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ee877195-9006-4bba-b362-0fa45d32927e tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] finish_migration finished successfully. {{(pid=74441) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e1d1ca3-111b-4908-bed5-3cc9f84f39b1 req-1ce55164-bd14-4319-8bfc-65a2ee3bc797 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e1d1ca3-111b-4908-bed5-3cc9f84f39b1 req-1ce55164-bd14-4319-8bfc-65a2ee3bc797 service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e1d1ca3-111b-4908-bed5-3cc9f84f39b1 req-1ce55164-bd14-4319-8bfc-65a2ee3bc797 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8e1d1ca3-111b-4908-bed5-3cc9f84f39b1 req-1ce55164-bd14-4319-8bfc-65a2ee3bc797 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:00:56 user nova-compute[74441]: DEBUG nova.compute.manager [req-8e1d1ca3-111b-4908-bed5-3cc9f84f39b1 req-1ce55164-bd14-4319-8bfc-65a2ee3bc797 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:00:56 user nova-compute[74441]: WARNING nova.compute.manager [req-8e1d1ca3-111b-4908-bed5-3cc9f84f39b1 req-1ce55164-bd14-4319-8bfc-65a2ee3bc797 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state active and task_state resize_finish.
Nov 09 01:00:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updating instance_info_cache with network_info: [{"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-28c6a03d-4257-41ff-8fdf-7863286b9b03" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:00:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:00:59 user nova-compute[74441]: INFO nova.compute.manager [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Detaching volume a5632f8f-dae5-4f98-88b4-ae8ef309aee2
Nov 09 01:00:59 user nova-compute[74441]: INFO nova.virt.block_device [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Attempting to driver detach volume a5632f8f-dae5-4f98-88b4-ae8ef309aee2 from mountpoint /dev/vdb
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Attempting to detach device vdb from instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:00:59 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:59 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 01:00:59 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:59 user nova-compute[74441]:   <serial>a5632f8f-dae5-4f98-88b4-ae8ef309aee2</serial>
Nov 09 01:00:59 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:00:59 user nova-compute[74441]: </disk>
Nov 09 01:00:59 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:00:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully detached device vdb from instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 from the persistent domain config.
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:00:59 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:00:59 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 01:00:59 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:00:59 user nova-compute[74441]:   <serial>a5632f8f-dae5-4f98-88b4-ae8ef309aee2</serial>
Nov 09 01:00:59 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:00:59 user nova-compute[74441]: </disk>
Nov 09 01:00:59 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:00:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2c005b6-7adc-45e8-8539-8fd4306051d3 is timed out.
Nov 09 01:00:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Successfully detached device vdb from instance b2c005b6-7adc-45e8-8539-8fd4306051d3 from the live domain config.
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeKMUuqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:00:59 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[85035f25-11c7-44ba-ab0b-419824c1fbbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:00:59 user nova-compute[74441]: No targets found.
Nov 09 01:00:59 user nova-compute[74441]: iSNS:
Nov 09 01:00:59 user nova-compute[74441]: No targets found.
Nov 09 01:00:59 user nova-compute[74441]: STATIC:
Nov 09 01:00:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:00:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1
Nov 09 01:00:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2
Nov 09 01:00:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 01:00:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9
Nov 09 01:00:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:00:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:00:59 user nova-compute[74441]: FIRMWARE:
Nov 09 01:00:59 user nova-compute[74441]: No targets found.
Nov 09 01:00:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:00:59 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:00:59 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81120bc-c15e-4e3a-8859-ce3140ad3ec4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a6c6cb-183d-47e0-8df8-c2a4ee525ede]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:00:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c49c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d246dc-5b0e-43a6-8e2c-0c02409fd37c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c860eb3c-3045-4db4-a132-f76ad3bc6297]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1434bf-3cbe-42fb-9083-384c7893439f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669df01-7c18-44fc-9d3e-0135dad7e38b]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a96c92-834b-4555-83ed-de6a87d4e03b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12be7fc4-eab3-40fb-b017-919739b736c7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260]
Nov 09 01:00:59 user nova-compute[74441]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9, portal: 172.16.0.220,3260] successful.
Nov 09 01:00:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec3dc9a-166b-4b6c-80af-c63ec20058b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b7b12d-c625-4a21-8495-33f875c8dd87]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] <== disconnect_volume: return (399ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:00:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:01:00 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'flavor' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5db8e87b-573b-443c-b71e-5d18add92ee9 tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:02 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:09 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:01:09 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7837MB free_disk=24.86064910888672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Applying migration context for instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 as it has an incoming, in-progress migration 196f0abf-191e-4615-9a65-91d91852bc39. Migration status is finished {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 01:01:09 user nova-compute[74441]: INFO nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating resource usage from migration 196f0abf-191e-4615-9a65-91d91852bc39
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b2c005b6-7adc-45e8-8539-8fd4306051d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Migration 196f0abf-191e-4615-9a65-91d91852bc39 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:01:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:10 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 is timed out.
Nov 09 01:01:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config.
Nov 09 01:01:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGTqfBbt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:01:10 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0bf89c-abf1-47da-8867-0f31e8fe64a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:01:10 user nova-compute[74441]: No targets found.
Nov 09 01:01:10 user nova-compute[74441]: iSNS:
Nov 09 01:01:10 user nova-compute[74441]: No targets found.
Nov 09 01:01:10 user nova-compute[74441]: STATIC:
Nov 09 01:01:10 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:01:10 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:10 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:10 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1
Nov 09 01:01:10 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:10 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:10 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2
Nov 09 01:01:10 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:10 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:10 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 01:01:10 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:10 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:10 user nova-compute[74441]: FIRMWARE:
Nov 09 01:01:10 user nova-compute[74441]: No targets found.
Nov 09 01:01:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:01:10 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:01:10 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b94a8-e84e-4902-a8ec-584aadb71b82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[752f484e-585a-4cf3-afce-bd3375661834]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:10 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c13b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1'): ({'sde'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Removing single pathed devices sde {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d544300e-51d6-468d-a949-48a35c420710]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f1635-c976-4a71-a917-fccb2c5f2509]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Flushing IO for device /dev/sde {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4fd8b8-6ac2-4e06-b567-dfa1bf613cc4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:01:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc216e1-dc0e-4417-ac82-a09ae71e87b4]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0334ce1-61d2-4fb8-8633-300f53041ec2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdb427b-6981-4d13-9616-8629115b688c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260]
Nov 09 01:01:11 user nova-compute[74441]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1, portal: 172.16.0.220,3260] successful.
Nov 09 01:01:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aee7a7ab-f65c-4aff-9b18-18ee651a1ec1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf3bd26-070c-4ac9-97f6-4da89582daac]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== disconnect_volume: return (322ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing instance network info cache due to event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updated VIF entry in instance network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-df07641e-7b34-4587-8efd-a9e69641b987 req-a79678e9-c44c-4dec-9673-a59cc8c54c71 service nova] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:12 user nova-compute[74441]: INFO nova.compute.manager [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Detaching volume 487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 01:01:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:12 user nova-compute[74441]: INFO nova.virt.block_device [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Attempting to driver detach volume 487b96df-4f18-4b75-afd4-ffdb14bf7609 from mountpoint /dev/vdb
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Attempting to detach device vdb from instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:01:12 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:01:12 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:01:12 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:01:12 user nova-compute[74441]:   <serial>487b96df-4f18-4b75-afd4-ffdb14bf7609</serial>
Nov 09 01:01:12 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:01:12 user nova-compute[74441]: </disk>
Nov 09 01:01:12 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:01:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully detached device vdb from instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f from the persistent domain config.
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:01:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:01:12 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:01:12 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:01:12 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:01:12 user nova-compute[74441]:   <serial>487b96df-4f18-4b75-afd4-ffdb14bf7609</serial>
Nov 09 01:01:12 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:01:12 user nova-compute[74441]: </disk>
Nov 09 01:01:12 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:01:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing instance network info cache due to event network-changed-60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] Acquiring lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] Acquired lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Refreshing network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updated VIF entry in instance network info cache for port 60f43fd6-011f-4bcc-b3b4-c44eef2851fa. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [{"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7f0a1a37-5da8-402a-8a2a-3606f358360d req-6faed05f-542a-40f9-a7d0-76b35daa8cd6 service nova] Releasing lock "refresh_cache-7563d22d-e7a8-44fe-b7ac-580dca7ee84f" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:01:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "d45bc134-12bc-47fb-a59b-a697a3991f3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "d45bc134-12bc-47fb-a59b-a697a3991f3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:01:18 user nova-compute[74441]: INFO nova.compute.claims [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Claim successful on node user
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:01:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.policy [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd80ab02de6b249c3adecf0597940ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9194fd2e7248a2bdbfd3d57f846fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:01:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 is timed out.
Nov 09 01:01:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully detached device vdb from instance 28c6a03d-4257-41ff-8fdf-7863286b9b03 from the live domain config.
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lvrYtjWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:01:19 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: INFO nova.virt.block_device [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Booting with volume 045a6c86-d528-4b30-aa51-1bfbe5d2a655 at /dev/vda
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b472569-61f7-47e3-be30-1a2470456caf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:01:19 user nova-compute[74441]: No targets found.
Nov 09 01:01:19 user nova-compute[74441]: iSNS:
Nov 09 01:01:19 user nova-compute[74441]: No targets found.
Nov 09 01:01:19 user nova-compute[74441]: STATIC:
Nov 09 01:01:19 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:01:19 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:19 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:19 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2
Nov 09 01:01:19 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:19 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:19 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 01:01:19 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:19 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:19 user nova-compute[74441]: FIRMWARE:
Nov 09 01:01:19 user nova-compute[74441]: No targets found.
Nov 09 01:01:19 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:01:19 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:01:19 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e3fd1e-e6f1-4481-b8e6-76410365997a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.utils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[02233f05-af98-4cf7-94c7-4e6c1857fd9c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:19 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:01:19 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:19 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:19 user nova-compute[74441]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 (non-flash)
Nov 09 01:01:19 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:19 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c6709d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3a3a2-c9b6-435b-93b4-e9c1b16abd88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef89afd-2ba6-4167-b65f-de84301e59b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acae73b-9aaa-440e-93c7-786c55fadd0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45c7c9-1ce3-4443-be71-75392ac1f7a8]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d252671a-db8b-4ffa-bfe2-ae5578046b10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c38bf8-784a-47cb-a12d-8ec8f6ffc7cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[390915b1-8359-46f0-94aa-5ea73d6f4570]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:01:19 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:01:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0250a-b239-421d-951e-75ed75e5bfcf]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG os_brick.utils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:01:19 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Updating existing volume attachment record: f3d5aa84-88d6-4fbc-827d-02d9ae77231c {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e0fe01-1861-4361-9da4-9e4902d6cc1d]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73b722f-d915-4db9-94c9-b9601d78e8a9]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54c6e6-6bea-4617-a2ff-1cd92e82c047]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260]
Nov 09 01:01:20 user nova-compute[74441]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2, portal: 172.16.0.220,3260] successful.
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5632f8f-dae5-4f98-88b4-ae8ef309aee2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1804c720-a2e3-4239-a29c-3584c826ae9a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== disconnect_volume: return (380ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Successfully created port: 77f86914-ffe5-4d58-9c8c-0ade18a9ddb7 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.objects.instance [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1de4e474-e7bd-4aff-b6a6-3472110b0f35 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.037s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:01:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Creating image(s)
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Ensure instance console log exists: /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Start _get_guest_xml network_info=[{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a31fa46-141c-4685-9c9b-abf78eb549f9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2fed908-bbff-4c17-ad25-5b69d384b087', 'serial': 'b2fed908-bbff-4c17-ad25-5b69d384b087'}, 'attachment_id': '021c4fe1-1291-479a-8e77-330f6267a062', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:01:20 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:01:20 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:01:20 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:01:20 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:01:20 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf58f5d-973f-49e8-b20e-ea530e6937fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:01:20 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[563fdc79-0fe9-47b2-ab62-c149a3e96acb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087] added
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[862d9841-00d6-47de-9883-8a21fcbfe5c6]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[25019d27-7c68-4e40-95a7-f84b2b2a7218]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJFOLzBW {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJFOLzBW" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2b5a8-085a-4e1a-8a2d-d3255aed638f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJFOLzBW'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e814c03-d32f-4406-9d8b-269949296e52]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc617b97-5f29-4f54-b95a-8d5f29668e03]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Successfully updated port: 77f86914-ffe5-4d58-9c8c-0ade18a9ddb7 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "refresh_cache-d45bc134-12bc-47fb-a59b-a697a3991f3d" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquired lock "refresh_cache-d45bc134-12bc-47fb-a59b-a697a3991f3d" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac5882c-5d54-4a0f-82ea-f35c0d0dafd5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260]
Nov 09 01:01:20 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260] successful.
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Received event network-changed-77f86914-ffe5-4d58-9c8c-0ade18a9ddb7 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Refreshing instance network info cache due to event network-changed-77f86914-ffe5-4d58-9c8c-0ade18a9ddb7. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] Acquiring lock "refresh_cache-d45bc134-12bc-47fb-a59b-a697a3991f3d" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e49a0-4fb7-45f3-996a-e5a531344984]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7b720-5cc1-4d69-bf36-6cad6e1e3c5c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:01:20 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7296a6-2e73-4bbc-bdf9-e6d29f101cf0]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:20 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 28c6a03d-4257-41ff-8fdf-7863286b9b03 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Updating instance_info_cache with network_info: [{"id": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "address": "fa:16:3e:89:30:4a", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86914-ff", "ovs_interfaceid": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Releasing lock "refresh_cache-d45bc134-12bc-47fb-a59b-a697a3991f3d" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Instance network_info: |[{"id": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "address": "fa:16:3e:89:30:4a", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86914-ff", "ovs_interfaceid": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] Acquired lock "refresh_cache-d45bc134-12bc-47fb-a59b-a697a3991f3d" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.network.neutron [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Refreshing network info cache for port 77f86914-ffe5-4d58-9c8c-0ade18a9ddb7 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-67629951-9822-4d2d-8129-c457257c1330 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.116s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23562643861316239', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562643861316239', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643861038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643861038',id=33,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-lv0x5x23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:00:33Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=1a31fa46-141c-4685-9c9b-abf78eb549f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:01:21 user nova-compute[74441]:   <uuid>1a31fa46-141c-4685-9c9b-abf78eb549f9</uuid>
Nov 09 01:01:21 user nova-compute[74441]:   <name>instance-00000021</name>
Nov 09 01:01:21 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:01:21 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:01:21 user nova-compute[74441]:   <metadata>
Nov 09 01:01:21 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:01:21 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:01:21 user nova-compute[74441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1643861038</nova:name>
Nov 09 01:01:21 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:01:20</nova:creationTime>
Nov 09 01:01:21 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:01:21 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:01:21 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:01:21 user nova-compute[74441]:       <nova:owner>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:user uuid="ffa1084de0be460fa924e3f124e47a21">tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member</nova:user>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:project uuid="aaf77bd26a3e4bb1831823704242a3b6">tempest-ServerBootFromVolumeStableRescueTest-1850620491</nova:project>
Nov 09 01:01:21 user nova-compute[74441]:       </nova:owner>
Nov 09 01:01:21 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:01:21 user nova-compute[74441]:       <nova:ports>
Nov 09 01:01:21 user nova-compute[74441]:         <nova:port uuid="add2e353-4f48-4a42-8eee-955da3ff6b11">
Nov 09 01:01:21 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 01:01:21 user nova-compute[74441]:         </nova:port>
Nov 09 01:01:21 user nova-compute[74441]:       </nova:ports>
Nov 09 01:01:21 user nova-compute[74441]:     </nova:instance>
Nov 09 01:01:21 user nova-compute[74441]:   </metadata>
Nov 09 01:01:21 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:01:21 user nova-compute[74441]:     <system>
Nov 09 01:01:21 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:01:21 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:01:21 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:01:21 user nova-compute[74441]:       <entry name="serial">1a31fa46-141c-4685-9c9b-abf78eb549f9</entry>
Nov 09 01:01:21 user nova-compute[74441]:       <entry name="uuid">1a31fa46-141c-4685-9c9b-abf78eb549f9</entry>
Nov 09 01:01:21 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:01:21 user nova-compute[74441]:     </system>
Nov 09 01:01:21 user nova-compute[74441]:   </sysinfo>
Nov 09 01:01:21 user nova-compute[74441]:   <os>
Nov 09 01:01:21 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:01:21 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:01:21 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:01:21 user nova-compute[74441]:   </os>
Nov 09 01:01:21 user nova-compute[74441]:   <features>
Nov 09 01:01:21 user nova-compute[74441]:     <acpi/>
Nov 09 01:01:21 user nova-compute[74441]:     <apic/>
Nov 09 01:01:21 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:01:21 user nova-compute[74441]:   </features>
Nov 09 01:01:21 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:01:21 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:01:21 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:01:21 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:01:21 user nova-compute[74441]:   </clock>
Nov 09 01:01:21 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:01:21 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:01:21 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:01:21 user nova-compute[74441]:   </cpu>
Nov 09 01:01:21 user nova-compute[74441]:   <devices>
Nov 09 01:01:21 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:01:21 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:01:21 user nova-compute[74441]:       <source dev="/dev/sdc"/>
Nov 09 01:01:21 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:01:21 user nova-compute[74441]:       <serial>b2fed908-bbff-4c17-ad25-5b69d384b087</serial>
Nov 09 01:01:21 user nova-compute[74441]:     </disk>
Nov 09 01:01:21 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:01:21 user nova-compute[74441]:       <mac address="fa:16:3e:a3:74:97"/>
Nov 09 01:01:21 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:01:21 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:01:21 user nova-compute[74441]:       <target dev="tapadd2e353-4f"/>
Nov 09 01:01:21 user nova-compute[74441]:     </interface>
Nov 09 01:01:21 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:01:21 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/console.log" append="off"/>
Nov 09 01:01:21 user nova-compute[74441]:     </serial>
Nov 09 01:01:21 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:01:21 user nova-compute[74441]:     <video>
Nov 09 01:01:21 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:01:21 user nova-compute[74441]:     </video>
Nov 09 01:01:21 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:01:21 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:01:21 user nova-compute[74441]:     </rng>
Nov 09 01:01:21 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:01:21 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:01:21 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:01:21 user nova-compute[74441]:     </memballoon>
Nov 09 01:01:21 user nova-compute[74441]:   </devices>
Nov 09 01:01:21 user nova-compute[74441]: </domain>
Nov 09 01:01:21 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643861038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643861038',id=33,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-lv0x5x23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:00:33Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=1a31fa46-141c-4685-9c9b-abf78eb549f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG os_vif [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dc50ff1-c824-554a-b5ba-25e76d098af3', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Updated VIF entry in instance network info cache for port 77f86914-ffe5-4d58-9c8c-0ade18a9ddb7. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Updating instance_info_cache with network_info: [{"id": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "address": "fa:16:3e:89:30:4a", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86914-ff", "ovs_interfaceid": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd2e353-4f, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd2e353-4f, col_values=(('qos', UUID('98f86a9c-fa94-4fbf-b020-3b1e00e5dd28')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd2e353-4f, col_values=(('external_ids', {'iface-id': 'add2e353-4f48-4a42-8eee-955da3ff6b11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:74:97', 'vm-uuid': '1a31fa46-141c-4685-9c9b-abf78eb549f9'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-993be54e-2040-4204-ae10-f7bdbe9aeb7f req-3eaec13d-6349-4a76-9f4f-6dfbe5960338 service nova] Releasing lock "refresh_cache-d45bc134-12bc-47fb-a59b-a697a3991f3d" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:22 user nova-compute[74441]: INFO os_vif [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f')
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:01:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No VIF found with MAC fa:16:3e:a3:74:97, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-ba237f5f-6e2a-4739-b7da-15373cfec8fc req-28180a93-4926-4efc-8cc0-e9a8f722b1f0 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ba237f5f-6e2a-4739-b7da-15373cfec8fc req-28180a93-4926-4efc-8cc0-e9a8f722b1f0 service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ba237f5f-6e2a-4739-b7da-15373cfec8fc req-28180a93-4926-4efc-8cc0-e9a8f722b1f0 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ba237f5f-6e2a-4739-b7da-15373cfec8fc req-28180a93-4926-4efc-8cc0-e9a8f722b1f0 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-ba237f5f-6e2a-4739-b7da-15373cfec8fc req-28180a93-4926-4efc-8cc0-e9a8f722b1f0 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:23 user nova-compute[74441]: WARNING nova.compute.manager [req-ba237f5f-6e2a-4739-b7da-15373cfec8fc req-28180a93-4926-4efc-8cc0-e9a8f722b1f0 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state building and task_state spawning.
Nov 09 01:01:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:01:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance spawned successfully.
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:01:25 user nova-compute[74441]: INFO nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-59bb67c6-0995-4e93-80c6-5463593fceb0 req-3ca20d27-bd86-42e9-9997-108bdc570047 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-59bb67c6-0995-4e93-80c6-5463593fceb0 req-3ca20d27-bd86-42e9-9997-108bdc570047 service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-59bb67c6-0995-4e93-80c6-5463593fceb0 req-3ca20d27-bd86-42e9-9997-108bdc570047 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-59bb67c6-0995-4e93-80c6-5463593fceb0 req-3ca20d27-bd86-42e9-9997-108bdc570047 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-59bb67c6-0995-4e93-80c6-5463593fceb0 req-3ca20d27-bd86-42e9-9997-108bdc570047 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:25 user nova-compute[74441]: WARNING nova.compute.manager [req-59bb67c6-0995-4e93-80c6-5463593fceb0 req-3ca20d27-bd86-42e9-9997-108bdc570047 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state building and task_state spawning.
Nov 09 01:01:25 user nova-compute[74441]: INFO nova.compute.manager [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Took 53.63 seconds to build instance.
Nov 09 01:01:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-564643d9-6e66-4597-b0c5-f0bc7248f002 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.747s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:29 user nova-compute[74441]: INFO nova.compute.manager [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Terminating instance
Nov 09 01:01:29 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-0af7cfeb-5d35-465c-941f-2ee073ac6cfe req-db1bd6fd-6f23-4057-9b00-dffca0778933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0af7cfeb-5d35-465c-941f-2ee073ac6cfe req-db1bd6fd-6f23-4057-9b00-dffca0778933 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0af7cfeb-5d35-465c-941f-2ee073ac6cfe req-db1bd6fd-6f23-4057-9b00-dffca0778933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0af7cfeb-5d35-465c-941f-2ee073ac6cfe req-db1bd6fd-6f23-4057-9b00-dffca0778933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-0af7cfeb-5d35-465c-941f-2ee073ac6cfe req-db1bd6fd-6f23-4057-9b00-dffca0778933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-0af7cfeb-5d35-465c-941f-2ee073ac6cfe req-db1bd6fd-6f23-4057-9b00-dffca0778933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Instance destroyed successfully.
Nov 09 01:01:30 user nova-compute[74441]: DEBUG nova.objects.instance [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lazy-loading 'resources' on Instance uuid b2c005b6-7adc-45e8-8539-8fd4306051d3 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:53:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-19428943',display_name='tempest-ServerStableDeviceRescueTest-server-19428943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-19428943',id=25,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4LPSIna8kft7F4sBbm/duxspyUfEVb9REdJOUO2pZWntMsgKir3VHMUe6SlTp8yatezmObML5DzdDAQflmKIKLSd0OQpmkHn0ooQSn2FtV8M9rMw7LYrkrTquMBagW9w==',key_name='tempest-keypair-496424780',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b33fe89e4a824e22a4bea354a547302f',ramdisk_id='',reservation_id='r-1hwhh3yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1228913245',owner_user_name='tempest-ServerStableDeviceRescueTest-1228913245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741a4f427124857be6d3d1f1e512eb0',uuid=b2c005b6-7adc-45e8-8539-8fd4306051d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converting VIF {"id": "494268cb-cba1-478a-a7a2-7657f2134dd5", "address": "fa:16:3e:eb:16:fe", "network": {"id": "17c2ce8e-bafa-4783-9920-0cd294912371", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1643271290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b33fe89e4a824e22a4bea354a547302f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap494268cb-cb", "ovs_interfaceid": "494268cb-cba1-478a-a7a2-7657f2134dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG os_vif [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap494268cb-cb, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91709c1b-34a9-4b42-8fed-1c41a1122938) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:01:30 user nova-compute[74441]: INFO os_vif [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:16:fe,bridge_name='br-int',has_traffic_filtering=True,id=494268cb-cba1-478a-a7a2-7657f2134dd5,network=Network(17c2ce8e-bafa-4783-9920-0cd294912371),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap494268cb-cb')
Nov 09 01:01:30 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Deleting instance files /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3_del
Nov 09 01:01:30 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Deletion of /opt/stack/data/nova/instances/b2c005b6-7adc-45e8-8539-8fd4306051d3_del complete
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: INFO nova.compute.manager [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 01:01:30 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:31 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Took 1.29 seconds to deallocate network for instance.
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:31 user nova-compute[74441]: WARNING nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state deleted and task_state None.
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:31 user nova-compute[74441]: WARNING nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state deleted and task_state None.
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:31 user nova-compute[74441]: WARNING nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state deleted and task_state None.
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:31 user nova-compute[74441]: WARNING nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-unplugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state deleted and task_state None.
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Acquiring lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] No waiting events found dispatching network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:31 user nova-compute[74441]: WARNING nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received unexpected event network-vif-plugged-494268cb-cba1-478a-a7a2-7657f2134dd5 for instance with vm_state deleted and task_state None.
Nov 09 01:01:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-7c1986ad-f977-43ed-9f40-748212ec7bde req-2b47789e-9143-4853-ae6e-cf1f754c0933 service nova] [instance: b2c005b6-7adc-45e8-8539-8fd4306051d3] Received event network-vif-deleted-494268cb-cba1-478a-a7a2-7657f2134dd5 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:32 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:01:32 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:01:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:32 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Deleted allocations for instance b2c005b6-7adc-45e8-8539-8fd4306051d3
Nov 09 01:01:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9b7f199d-a1c5-4375-aafe-d33bdc60254b tempest-ServerStableDeviceRescueTest-1228913245 tempest-ServerStableDeviceRescueTest-1228913245-project-member] Lock "b2c005b6-7adc-45e8-8539-8fd4306051d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.775s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:33 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f is timed out.
Nov 09 01:01:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully detached device vdb from instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f from the live domain config.
Nov 09 01:01:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZqKrchb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:01:33 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e399a90-9dac-42b0-aedd-9ec6c9ac1f55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:01:33 user nova-compute[74441]: No targets found.
Nov 09 01:01:33 user nova-compute[74441]: iSNS:
Nov 09 01:01:33 user nova-compute[74441]: No targets found.
Nov 09 01:01:33 user nova-compute[74441]: STATIC:
Nov 09 01:01:33 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:01:33 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:33 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:33 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609
Nov 09 01:01:33 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:33 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:33 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:01:33 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:01:33 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:01:33 user nova-compute[74441]: FIRMWARE:
Nov 09 01:01:33 user nova-compute[74441]: No targets found.
Nov 09 01:01:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:01:33 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:01:33 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d698360-c0cf-4543-b8f1-34dee2995887]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4764ba-2633-46b3-abd8-5769a531a61a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:33 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:33 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:01:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 (non-flash)
Nov 09 01:01:33 user nova-compute[74441]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:01:33 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:01:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c57d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0332ce96-6c70-4a1c-b087-182f69d280aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8230ce1b-0011-46df-a09f-3dce195c4074]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5033323-094f-465a-8f2b-a842fd8bdb1a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e550956e-762d-4b9d-9dd1-8861eba4880f]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80f7f3-31f2-4937-bf7a-696fece06d3e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d78417-ef07-4799-be67-b8e124e7d914]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260]
Nov 09 01:01:33 user nova-compute[74441]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609, portal: 172.16.0.220,3260] successful.
Nov 09 01:01:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:487b96df-4f18-4b75-afd4-ffdb14bf7609 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6652726-4f6c-47cf-8097-12e40e7e8c8f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] <== disconnect_volume: return (289ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:01:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:01:34 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'flavor' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f824b58d-e04f-49f5-ba3d-daf1f932daf5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.997s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.volume.cinder [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Update attachment failed for attachment f3d5aa84-88d6-4fbc-827d-02d9ae77231c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Traceback (most recent call last):
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     driver_block_device.attach_block_devices(
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     _log_and_attach(device)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     bdm.attach(*attach_args, **attach_kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     self._do_attach(context, instance, volume, volume_api,
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     self._volume_attach(context, volume, connector, instance,
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     connection_info = volume_api.attachment_update(
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     res = method(self, ctx, *args, **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     with excutils.save_and_reraise_exception():
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     self.force_reraise()
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     raise self.value
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     return method.func(obj, *args, **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     resp = self._update('/attachments/%s' % id, body)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     return self.request(url, method, **kwargs)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d]     raise exceptions.from_response(resp, body)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12)
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] 
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.claims [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Aborting claim: <nova.compute.claims.Claim object at 0x7f011c4282e0> {{(pid=74441) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.418s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Build of instance d45bc134-12bc-47fb-a59b-a697a3991f3d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12) {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.utils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Build of instance d45bc134-12bc-47fb-a59b-a697a3991f3d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74441) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 09 01:01:35 user nova-compute[74441]: ERROR nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Build of instance d45bc134-12bc-47fb-a59b-a697a3991f3d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12): nova.exception.BuildAbortException: Build of instance d45bc134-12bc-47fb-a59b-a697a3991f3d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12)
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Unplugging VIFs for instance {{(pid=74441) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1673514803',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1673514803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1673514803',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBu2AM054vuUnD7Dfk3vTjbaM3h5EiZt7xpsnBTvkfMoAyjvbFyii+9GKB0O42CXk++7L5z+OeubImm4By/7DJgxnE9SEraFrXJhwuzcntGKPa5CA0ShaIT8A3Tp0w6aA==',key_name='tempest-keypair-64660647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-0a443t40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d80ab02de6b249c3adecf0597940ea76',uuid=d45bc134-12bc-47fb-a59b-a697a3991f3d,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "address": "fa:16:3e:89:30:4a", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86914-ff", "ovs_interfaceid": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "address": "fa:16:3e:89:30:4a", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77f86914-ff", "ovs_interfaceid": "77f86914-ffe5-4d58-9c8c-0ade18a9ddb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:30:4a,bridge_name='br-int',has_traffic_filtering=True,id=77f86914-ffe5-4d58-9c8c-0ade18a9ddb7,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86914-ff') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG os_vif [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:30:4a,bridge_name='br-int',has_traffic_filtering=True,id=77f86914-ffe5-4d58-9c8c-0ade18a9ddb7,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86914-ff') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77f86914-ff, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:01:35 user nova-compute[74441]: INFO os_vif [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:30:4a,bridge_name='br-int',has_traffic_filtering=True,id=77f86914-ffe5-4d58-9c8c-0ade18a9ddb7,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77f86914-ff')
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Unplugged VIFs for instance {{(pid=74441) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:35 user nova-compute[74441]: INFO nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Took 0.46 seconds to deallocate network for instance.
Nov 09 01:01:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Detaching volume: 045a6c86-d528-4b30-aa51-1bfbe5d2a655 {{(pid=74441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 09 01:01:35 user nova-compute[74441]: INFO nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Detaching volume 045a6c86-d528-4b30-aa51-1bfbe5d2a655
Nov 09 01:01:36 user nova-compute[74441]: ERROR nova.virt.block_device [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Unable to call for a driver detach of volume 045a6c86-d528-4b30-aa51-1bfbe5d2a655 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance d45bc134-12bc-47fb-a59b-a697a3991f3d aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5befd0f9-006e-4c8c-9549-8f6d8db7ef12)
Nov 09 01:01:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: d45bc134-12bc-47fb-a59b-a697a3991f3d] Deleting volume: 045a6c86-d528-4b30-aa51-1bfbe5d2a655 {{(pid=74441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 01:01:36 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Deleted allocations for instance d45bc134-12bc-47fb-a59b-a697a3991f3d
Nov 09 01:01:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6c3dfb9c-5a5a-4e31-ad69-0ffb885002e5 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "d45bc134-12bc-47fb-a59b-a697a3991f3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.667s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4870-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:01:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:01:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:01:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:01:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:49 user nova-compute[74441]: INFO nova.compute.manager [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Terminating instance
Nov 09 01:01:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG nova.compute.manager [req-1629b290-d66e-4a47-8c28-f4e8b4516a65 req-84ffacf8-025f-4e73-9dc6-f9bab93a3d2d service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-vif-unplugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1629b290-d66e-4a47-8c28-f4e8b4516a65 req-84ffacf8-025f-4e73-9dc6-f9bab93a3d2d service nova] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1629b290-d66e-4a47-8c28-f4e8b4516a65 req-84ffacf8-025f-4e73-9dc6-f9bab93a3d2d service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1629b290-d66e-4a47-8c28-f4e8b4516a65 req-84ffacf8-025f-4e73-9dc6-f9bab93a3d2d service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG nova.compute.manager [req-1629b290-d66e-4a47-8c28-f4e8b4516a65 req-84ffacf8-025f-4e73-9dc6-f9bab93a3d2d service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] No waiting events found dispatching network-vif-unplugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:49 user nova-compute[74441]: DEBUG nova.compute.manager [req-1629b290-d66e-4a47-8c28-f4e8b4516a65 req-84ffacf8-025f-4e73-9dc6-f9bab93a3d2d service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-vif-unplugged-d717870f-6154-4cd5-997c-59d531b34884 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:01:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Instance destroyed successfully.
Nov 09 01:01:50 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'resources' on Instance uuid 28c6a03d-4257-41ff-8fdf-7863286b9b03 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:55:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1854501932',display_name='tempest-AttachVolumeNegativeTest-server-1854501932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1854501932',id=27,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6HWIPYqi8FMWEBqMDd02PhV1ngIaAMELv5Rgnu24uBfKSkdJ+9ya3paHv/e58LV/Mm7OinuaQEyLvHHQHWtIJJESQ4s+oJT80VrRgCo+8FG4N/9p0RZHASAw7w1mg6Yw==',key_name='tempest-keypair-715302858',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-5av3buyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:55:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=28c6a03d-4257-41ff-8fdf-7863286b9b03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "d717870f-6154-4cd5-997c-59d531b34884", "address": "fa:16:3e:31:bd:c8", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd717870f-61", "ovs_interfaceid": "d717870f-6154-4cd5-997c-59d531b34884", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG os_vif [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd717870f-61, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c9a74b3-5db7-4291-86a2-c350d5080ff2) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:50 user nova-compute[74441]: INFO os_vif [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:bd:c8,bridge_name='br-int',has_traffic_filtering=True,id=d717870f-6154-4cd5-997c-59d531b34884,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd717870f-61')
Nov 09 01:01:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Deleting instance files /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03_del
Nov 09 01:01:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Deletion of /opt/stack/data/nova/instances/28c6a03d-4257-41ff-8fdf-7863286b9b03_del complete
Nov 09 01:01:50 user nova-compute[74441]: INFO nova.compute.manager [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 09 01:01:50 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:01:50 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:01:51 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Took 0.79 seconds to deallocate network for instance.
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:51 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Deleted allocations for instance 28c6a03d-4257-41ff-8fdf-7863286b9b03
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9dcec54-e290-4bf7-a152-b8c112d51b30 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] Acquiring lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] Lock "28c6a03d-4257-41ff-8fdf-7863286b9b03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] No waiting events found dispatching network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:01:51 user nova-compute[74441]: WARNING nova.compute.manager [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received unexpected event network-vif-plugged-d717870f-6154-4cd5-997c-59d531b34884 for instance with vm_state deleted and task_state None.
Nov 09 01:01:51 user nova-compute[74441]: DEBUG nova.compute.manager [req-da1244d8-8a0b-4252-ba6f-f375f1c60f8d req-33f01281-b20e-43fe-aad8-d24ec2534708 service nova] [instance: 28c6a03d-4257-41ff-8fdf-7863286b9b03] Received event network-vif-deleted-d717870f-6154-4cd5-997c-59d531b34884 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:01:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:52 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:01:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:01:53 user nova-compute[74441]: INFO nova.compute.manager [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attaching volume 951d8910-c9aa-49f7-8942-5e9658b3d67f to /dev/vdb
Nov 09 01:01:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b48084-2e42-4e31-8379-fc90db79f5c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1f0b8-98fd-48ab-9021-6bea08d20c0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f7711b-179e-4709-a1bf-8f8c975ab990]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[543074d6-97bc-4c61-b23a-d73b31c7160e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:01:53 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:01:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e00bd84-3b24-4701-afd8-e7dc1f891dcd]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating existing volume attachment record: 8590c464-0001-4073-a1ae-f300319ea360 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:01:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:01:57 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:01:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:01:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:02:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:03 user nova-compute[74441]: INFO nova.compute.manager [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Terminating instance
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-9cd27293-efa1-4a8d-8a34-235aabf38223 req-2b97f78b-ce3c-4fd1-89d8-241c79eeb15e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9cd27293-efa1-4a8d-8a34-235aabf38223 req-2b97f78b-ce3c-4fd1-89d8-241c79eeb15e service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9cd27293-efa1-4a8d-8a34-235aabf38223 req-2b97f78b-ce3c-4fd1-89d8-241c79eeb15e service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9cd27293-efa1-4a8d-8a34-235aabf38223 req-2b97f78b-ce3c-4fd1-89d8-241c79eeb15e service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-9cd27293-efa1-4a8d-8a34-235aabf38223 req-2b97f78b-ce3c-4fd1-89d8-241c79eeb15e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-9cd27293-efa1-4a8d-8a34-235aabf38223 req-2b97f78b-ce3c-4fd1-89d8-241c79eeb15e service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-unplugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Instance destroyed successfully.
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.objects.instance [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'resources' on Instance uuid 7563d22d-e7a8-44fe-b7ac-580dca7ee84f {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-554245283',display_name='tempest-ServerRescueNegativeTestJSON-server-554245283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-554245283',id=26,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQqlUfG8BrsdzHhNOWOVwvqa5jDWP2pkMx0+n1NOnQXjDTqRMFh3EUPB0E8JrozViUG83Y17NN8/ojBacrvRZuUmy2R1C7ZIafZmhBhB1aKMv3H2HoYLV8TkfpWuKdqhw==',key_name='tempest-keypair-957892293',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:57:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-umenp4ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='383f477236d64d908d2a2868166d4107',uuid=7563d22d-e7a8-44fe-b7ac-580dca7ee84f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "address": "fa:16:3e:a3:32:4a", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f43fd6-01", "ovs_interfaceid": "60f43fd6-011f-4bcc-b3b4-c44eef2851fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG os_vif [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f43fd6-01, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a49213dd-06b0-4e8c-be03-69c96186833c) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:03 user nova-compute[74441]: INFO os_vif [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:32:4a,bridge_name='br-int',has_traffic_filtering=True,id=60f43fd6-011f-4bcc-b3b4-c44eef2851fa,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f43fd6-01')
Nov 09 01:02:03 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Deleting instance files /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f_del
Nov 09 01:02:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Deletion of /opt/stack/data/nova/instances/7563d22d-e7a8-44fe-b7ac-580dca7ee84f_del complete
Nov 09 01:02:04 user nova-compute[74441]: INFO nova.compute.manager [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 09 01:02:04 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:02:04 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:02:04 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:02:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:04 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:04 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Took 0.87 seconds to deallocate network for instance.
Nov 09 01:02:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-34e54e6b-a6ee-45fc-8229-13898554f865 req-18dcf6a2-ca8e-4fc3-a25c-b7a0d303a93d service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-deleted-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:05 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Deleted allocations for instance 7563d22d-e7a8-44fe-b7ac-580dca7ee84f
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-091feae5-11c4-48cf-b67e-c3f5bd7d2fa5 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-901d63a6-7214-420c-886d-d15d1bfa44e7 req-1eb15532-2c73-4b28-9d21-6ac036f4cbaa service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-901d63a6-7214-420c-886d-d15d1bfa44e7 req-1eb15532-2c73-4b28-9d21-6ac036f4cbaa service nova] Acquiring lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-901d63a6-7214-420c-886d-d15d1bfa44e7 req-1eb15532-2c73-4b28-9d21-6ac036f4cbaa service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-901d63a6-7214-420c-886d-d15d1bfa44e7 req-1eb15532-2c73-4b28-9d21-6ac036f4cbaa service nova] Lock "7563d22d-e7a8-44fe-b7ac-580dca7ee84f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-901d63a6-7214-420c-886d-d15d1bfa44e7 req-1eb15532-2c73-4b28-9d21-6ac036f4cbaa service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] No waiting events found dispatching network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:02:05 user nova-compute[74441]: WARNING nova.compute.manager [req-901d63a6-7214-420c-886d-d15d1bfa44e7 req-1eb15532-2c73-4b28-9d21-6ac036f4cbaa service nova] [instance: 7563d22d-e7a8-44fe-b7ac-580dca7ee84f] Received unexpected event network-vif-plugged-60f43fd6-011f-4bcc-b3b4-c44eef2851fa for instance with vm_state deleted and task_state None.
Nov 09 01:02:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:06 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Going to confirm migration 2 {{(pid=74441) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 09 01:02:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquired lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:02:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'info_cache' on Instance uuid 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.network.neutron [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [{"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Releasing lock "refresh_cache-53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'migration_context' on Instance uuid 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.objects.base [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Object Instance<53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38> lazy-loaded attributes: info_cache,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.467s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:07 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Deleted allocation for migration 196f0abf-191e-4615-9a65-91d91852bc39
Nov 09 01:02:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8b30f51f-567d-46e4-b93a-c56fc2843de2 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.464s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:09 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:09 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8069MB free_disk=25.030887603759766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:02:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQsdGzhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:02:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:02:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:02:17 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09efad0-3dc0-4977-ac63-a569041fc38f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:02:17 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e70e4e8-bc27-4932-9c30-5f414b9981cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f] added
Nov 09 01:02:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98684514-3d3e-4fe0-828f-e5d2b32ea0ad]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1162a946-2ae9-411d-bd61-bb63fcea5af1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQsdGzhE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uQsdGzhE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d4a46-d20d-4cbb-a24e-440b3bef5d1e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uQsdGzhE'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a84f2-3cc3-4e3c-9bc5-bb597986f22a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4850d2f3-974d-46ff-a087-40fc436a2bde]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0318762-8e4c-43e2-9346-7abbd5b0b140]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260]
Nov 09 01:02:17 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260] successful.
Nov 09 01:02:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae07303e-fb9b-4ae8-a623-6845d647f960]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a71f99a-39fe-46d9-ab70-c704f8272703]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f (non-flash)
Nov 09 01:02:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:17 user nova-compute[74441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f (non-flash)
Nov 09 01:02:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e36a5e9-74fc-468b-8bad-0e05171c444f]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:02:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQsdGzhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26266613731616566', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266613731616566', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:02:18 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:02:18 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:02:18 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:02:18 user nova-compute[74441]:   <serial>951d8910-c9aa-49f7-8942-5e9658b3d67f</serial>
Nov 09 01:02:18 user nova-compute[74441]: </disk>
Nov 09 01:02:18 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No VIF found with MAC fa:16:3e:45:27:b1, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:02:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-4c52a99a-5833-4481-9836-db3bf1fc65ea tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.929s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:21 user nova-compute[74441]: INFO nova.compute.manager [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Detaching volume 951d8910-c9aa-49f7-8942-5e9658b3d67f
Nov 09 01:02:21 user nova-compute[74441]: INFO nova.virt.block_device [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attempting to driver detach volume 951d8910-c9aa-49f7-8942-5e9658b3d67f from mountpoint /dev/vdb
Nov 09 01:02:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Attempting to detach device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:02:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:02:21 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:02:21 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:02:21 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:02:21 user nova-compute[74441]:   <serial>951d8910-c9aa-49f7-8942-5e9658b3d67f</serial>
Nov 09 01:02:21 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:02:21 user nova-compute[74441]: </disk>
Nov 09 01:02:21 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:02:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config.
Nov 09 01:02:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:02:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:02:21 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:02:21 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:02:21 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:02:21 user nova-compute[74441]:   <serial>951d8910-c9aa-49f7-8942-5e9658b3d67f</serial>
Nov 09 01:02:21 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:02:21 user nova-compute[74441]: </disk>
Nov 09 01:02:21 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:02:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:02:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:02:30 user nova-compute[74441]: INFO nova.compute.claims [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Claim successful on node user
Nov 09 01:02:30 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:30 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG nova.network.neutron [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:02:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:02:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:02:31 user nova-compute[74441]: INFO nova.virt.block_device [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Booting with volume 6735b743-7c32-4e88-bb56-8d21b3592c8a at /dev/vda
Nov 09 01:02:31 user nova-compute[74441]: DEBUG nova.policy [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd80ab02de6b249c3adecf0597940ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9194fd2e7248a2bdbfd3d57f846fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG os_brick.utils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0dadb8-cb53-4faf-97d9-b7b6e45ed2c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3e849-3e2f-45d6-a7c0-c6e0a29baadd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c92dec2-1cd1-463c-9d82-2afbf26a6ed5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c20af05-b1f1-43eb-99b7-6d66fb176be2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:02:31 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:02:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9db75d-5731-4923-9bbe-5b707f6dfc9b]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG os_brick.utils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:02:31 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updating existing volume attachment record: 5fc5e710-be9a-45e8-923c-7d85efebfb2e {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Successfully created port: 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Successfully updated port: 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquired lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG nova.network.neutron [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-changed-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG nova.compute.manager [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Refreshing instance network info cache due to event network-changed-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:02:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] Acquiring lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:33 user nova-compute[74441]: DEBUG nova.network.neutron [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:02:33 user nova-compute[74441]: DEBUG nova.network.neutron [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updating instance_info_cache with network_info: [{"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Releasing lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Instance network_info: |[{"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:02:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] Acquired lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:33 user nova-compute[74441]: DEBUG nova.network.neutron [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Refreshing network info cache for port 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:02:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updated VIF entry in instance network info cache for port 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:02:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updating instance_info_cache with network_info: [{"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ffea85de-642a-4985-8f94-40886ee53b15 req-8a3cb8d3-d503-4c86-8244-b0429292b540 service nova] Releasing lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:41 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 is timed out.
Nov 09 01:02:41 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config.
Nov 09 01:02:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uQsdGzhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:02:41 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7dffd-3dbb-41ec-8426-07f94bbf295e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:02:41 user nova-compute[74441]: No targets found.
Nov 09 01:02:41 user nova-compute[74441]: iSNS:
Nov 09 01:02:41 user nova-compute[74441]: No targets found.
Nov 09 01:02:41 user nova-compute[74441]: STATIC:
Nov 09 01:02:41 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:02:41 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:02:41 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:02:41 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:02:41 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:02:41 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:02:41 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f
Nov 09 01:02:41 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:02:41 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:02:41 user nova-compute[74441]: FIRMWARE:
Nov 09 01:02:41 user nova-compute[74441]: No targets found.
Nov 09 01:02:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:02:41 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:02:41 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fdd0b0-82d8-4e31-83b3-7aa0dfd2b953]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d586e8f-8086-400f-b10c-22dcf8b9abff]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:41 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:41 user nova-compute[74441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f (non-flash)
Nov 09 01:02:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:41 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:41 user nova-compute[74441]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f (non-flash)
Nov 09 01:02:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c43cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02abbb6-0468-47f7-8098-f097c1b87fe7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c397f797-0f39-43ad-9389-82bb1f1a789d]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:02:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bb7713-181c-495d-8db8-8c975fe5295b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c343b0ac-5971-4a1c-85f8-dd8acc70b20c]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0fce58-b8c9-4cde-8b59-7cc67ae6c38a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac7651b-b67e-43d8-92e1-8dd336f78b65]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260]
Nov 09 01:02:42 user nova-compute[74441]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f, portal: 172.16.0.220,3260] successful.
Nov 09 01:02:42 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:951d8910-c9aa-49f7-8942-5e9658b3d67f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb2e244-d2f2-412e-bc67-c7b6f1eb8d92]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== disconnect_volume: return (331ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:02:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:02:43 user nova-compute[74441]: INFO nova.compute.claims [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Claim successful on node user
Nov 09 01:02:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.network.neutron [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:02:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.policy [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '156577f25fe04e6e8ac3612c2a0dbc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e49bf75726243749bace44e94c1397b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:02:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Creating image(s)
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk 1073741824" returned: 0 in 0.057s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG nova.network.neutron [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Successfully created port: 84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Cannot resize image /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Ensure instance console log exists: /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Successfully updated port: 84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquired lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-changed-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Refreshing instance network info cache due to event network-changed-84b14b0f-58c9-4df8-952c-dabfea940a4e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] Acquiring lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updating instance_info_cache with network_info: [{"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Releasing lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Instance network_info: |[{"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] Acquired lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Refreshing network info cache for port 84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Start _get_guest_xml network_info=[{"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:02:45 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:45 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-718415875',display_name='tempest-AttachVolumeNegativeTest-server-718415875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-718415875',id=36,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENqpFrPokQCe07976akbCbTjXUuAQ3e94nnkjgOGavaPUlAMTGnVZtzKx19QJG/XuUKTimIZ32FIor8kPRyuRoZPzhCBAx+lFSLeTHFZBLXwoDG44DBHAbmbaii8GJFGg==',key_name='tempest-keypair-186690860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-kvq1rjf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=0dbaa8c6-468d-4c8b-ad95-58466c0bbe05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.objects.instance [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:02:45 user nova-compute[74441]:   <uuid>0dbaa8c6-468d-4c8b-ad95-58466c0bbe05</uuid>
Nov 09 01:02:45 user nova-compute[74441]:   <name>instance-00000024</name>
Nov 09 01:02:45 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:02:45 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:02:45 user nova-compute[74441]:   <metadata>
Nov 09 01:02:45 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:02:45 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:02:45 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-718415875</nova:name>
Nov 09 01:02:45 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:02:45</nova:creationTime>
Nov 09 01:02:45 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:02:45 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:02:45 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:02:45 user nova-compute[74441]:       <nova:owner>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:user uuid="156577f25fe04e6e8ac3612c2a0dbc4d">tempest-AttachVolumeNegativeTest-595140925-project-member</nova:user>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:project uuid="8e49bf75726243749bace44e94c1397b">tempest-AttachVolumeNegativeTest-595140925</nova:project>
Nov 09 01:02:45 user nova-compute[74441]:       </nova:owner>
Nov 09 01:02:45 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:02:45 user nova-compute[74441]:       <nova:ports>
Nov 09 01:02:45 user nova-compute[74441]:         <nova:port uuid="84b14b0f-58c9-4df8-952c-dabfea940a4e">
Nov 09 01:02:45 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 01:02:45 user nova-compute[74441]:         </nova:port>
Nov 09 01:02:45 user nova-compute[74441]:       </nova:ports>
Nov 09 01:02:45 user nova-compute[74441]:     </nova:instance>
Nov 09 01:02:45 user nova-compute[74441]:   </metadata>
Nov 09 01:02:45 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:02:45 user nova-compute[74441]:     <system>
Nov 09 01:02:45 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:02:45 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:02:45 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:02:45 user nova-compute[74441]:       <entry name="serial">0dbaa8c6-468d-4c8b-ad95-58466c0bbe05</entry>
Nov 09 01:02:45 user nova-compute[74441]:       <entry name="uuid">0dbaa8c6-468d-4c8b-ad95-58466c0bbe05</entry>
Nov 09 01:02:45 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:02:45 user nova-compute[74441]:     </system>
Nov 09 01:02:45 user nova-compute[74441]:   </sysinfo>
Nov 09 01:02:45 user nova-compute[74441]:   <os>
Nov 09 01:02:45 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:02:45 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:02:45 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:02:45 user nova-compute[74441]:   </os>
Nov 09 01:02:45 user nova-compute[74441]:   <features>
Nov 09 01:02:45 user nova-compute[74441]:     <acpi/>
Nov 09 01:02:45 user nova-compute[74441]:     <apic/>
Nov 09 01:02:45 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:02:45 user nova-compute[74441]:   </features>
Nov 09 01:02:45 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:02:45 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:02:45 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:02:45 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:02:45 user nova-compute[74441]:   </clock>
Nov 09 01:02:45 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:02:45 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:02:45 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:02:45 user nova-compute[74441]:   </cpu>
Nov 09 01:02:45 user nova-compute[74441]:   <devices>
Nov 09 01:02:45 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:02:45 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:02:45 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk"/>
Nov 09 01:02:45 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:02:45 user nova-compute[74441]:     </disk>
Nov 09 01:02:45 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:02:45 user nova-compute[74441]:       <mac address="fa:16:3e:9b:09:c4"/>
Nov 09 01:02:45 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:02:45 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:02:45 user nova-compute[74441]:       <target dev="tap84b14b0f-58"/>
Nov 09 01:02:45 user nova-compute[74441]:     </interface>
Nov 09 01:02:45 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:02:45 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/console.log" append="off"/>
Nov 09 01:02:45 user nova-compute[74441]:     </serial>
Nov 09 01:02:45 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:02:45 user nova-compute[74441]:     <video>
Nov 09 01:02:45 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:02:45 user nova-compute[74441]:     </video>
Nov 09 01:02:45 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:02:45 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:02:45 user nova-compute[74441]:     </rng>
Nov 09 01:02:45 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:02:45 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:02:45 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:02:45 user nova-compute[74441]:     </memballoon>
Nov 09 01:02:45 user nova-compute[74441]:   </devices>
Nov 09 01:02:45 user nova-compute[74441]: </domain>
Nov 09 01:02:45 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-718415875',display_name='tempest-AttachVolumeNegativeTest-server-718415875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-718415875',id=36,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENqpFrPokQCe07976akbCbTjXUuAQ3e94nnkjgOGavaPUlAMTGnVZtzKx19QJG/XuUKTimIZ32FIor8kPRyuRoZPzhCBAx+lFSLeTHFZBLXwoDG44DBHAbmbaii8GJFGg==',key_name='tempest-keypair-186690860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-kvq1rjf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=0dbaa8c6-468d-4c8b-ad95-58466c0bbe05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG os_vif [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ea509e4-64f7-5066-8c94-7e19332c7ce0', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84b14b0f-58, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84b14b0f-58, col_values=(('qos', UUID('7aefa19c-d633-421c-b2f2-a418f8bde91c')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84b14b0f-58, col_values=(('external_ids', {'iface-id': '84b14b0f-58c9-4df8-952c-dabfea940a4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:09:c4', 'vm-uuid': '0dbaa8c6-468d-4c8b-ad95-58466c0bbe05'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:45 user nova-compute[74441]: INFO os_vif [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58')
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:9b:09:c4, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updated VIF entry in instance network info cache for port 84b14b0f-58c9-4df8-952c-dabfea940a4e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.network.neutron [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updating instance_info_cache with network_info: [{"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4c250b59-d041-4b28-8f18-225d3a0da08f req-d1ba4323-c319-435e-855a-eb9c66a4ad6e service nova] Releasing lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:02:46 user nova-compute[74441]: INFO nova.compute.claims [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Claim successful on node user
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:02:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.policy [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d6713a112a64d03a7cd67c304a85ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aa9979e78d4597ae023610b56f5a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:02:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Creating image(s)
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk 1073741824" returned: 0 in 0.050s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Cannot resize image /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Ensure instance console log exists: /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Successfully created port: 65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Successfully updated port: 65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-changed-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Refreshing instance network info cache due to event network-changed-65db9fd8-e6f2-41f5-9bcc-e52d93471f61. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-e80e7af3-148a-4c3d-9ac6-8eaff2d7d8ff req-41c8822d-8bc6-4e9f-a49d-b875cf6153dc service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e80e7af3-148a-4c3d-9ac6-8eaff2d7d8ff req-41c8822d-8bc6-4e9f-a49d-b875cf6153dc service nova] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e80e7af3-148a-4c3d-9ac6-8eaff2d7d8ff req-41c8822d-8bc6-4e9f-a49d-b875cf6153dc service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e80e7af3-148a-4c3d-9ac6-8eaff2d7d8ff req-41c8822d-8bc6-4e9f-a49d-b875cf6153dc service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-e80e7af3-148a-4c3d-9ac6-8eaff2d7d8ff req-41c8822d-8bc6-4e9f-a49d-b875cf6153dc service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] No waiting events found dispatching network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:02:48 user nova-compute[74441]: WARNING nova.compute.manager [req-e80e7af3-148a-4c3d-9ac6-8eaff2d7d8ff req-41c8822d-8bc6-4e9f-a49d-b875cf6153dc service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received unexpected event network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e for instance with vm_state building and task_state spawning.
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance network_info: |[{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Refreshing network info cache for port 65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start _get_guest_xml network_info=[{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:02:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'pci_devices' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:02:48 user nova-compute[74441]:   <uuid>d64a477e-66b2-48b9-886d-ca146148167a</uuid>
Nov 09 01:02:48 user nova-compute[74441]:   <name>instance-00000025</name>
Nov 09 01:02:48 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:02:48 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:02:48 user nova-compute[74441]:   <metadata>
Nov 09 01:02:48 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:02:48 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:02:48 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1798271286</nova:name>
Nov 09 01:02:48 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:02:48</nova:creationTime>
Nov 09 01:02:48 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:02:48 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:02:48 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:02:48 user nova-compute[74441]:       <nova:owner>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:user uuid="9d6713a112a64d03a7cd67c304a85ddd">tempest-AttachVolumeTestJSON-1454008029-project-member</nova:user>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:project uuid="01aa9979e78d4597ae023610b56f5a60">tempest-AttachVolumeTestJSON-1454008029</nova:project>
Nov 09 01:02:48 user nova-compute[74441]:       </nova:owner>
Nov 09 01:02:48 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:02:48 user nova-compute[74441]:       <nova:ports>
Nov 09 01:02:48 user nova-compute[74441]:         <nova:port uuid="65db9fd8-e6f2-41f5-9bcc-e52d93471f61">
Nov 09 01:02:48 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 01:02:48 user nova-compute[74441]:         </nova:port>
Nov 09 01:02:48 user nova-compute[74441]:       </nova:ports>
Nov 09 01:02:48 user nova-compute[74441]:     </nova:instance>
Nov 09 01:02:48 user nova-compute[74441]:   </metadata>
Nov 09 01:02:48 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:02:48 user nova-compute[74441]:     <system>
Nov 09 01:02:48 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:02:48 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:02:48 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:02:48 user nova-compute[74441]:       <entry name="serial">d64a477e-66b2-48b9-886d-ca146148167a</entry>
Nov 09 01:02:48 user nova-compute[74441]:       <entry name="uuid">d64a477e-66b2-48b9-886d-ca146148167a</entry>
Nov 09 01:02:48 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:02:48 user nova-compute[74441]:     </system>
Nov 09 01:02:48 user nova-compute[74441]:   </sysinfo>
Nov 09 01:02:48 user nova-compute[74441]:   <os>
Nov 09 01:02:48 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:02:48 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:02:48 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:02:48 user nova-compute[74441]:   </os>
Nov 09 01:02:48 user nova-compute[74441]:   <features>
Nov 09 01:02:48 user nova-compute[74441]:     <acpi/>
Nov 09 01:02:48 user nova-compute[74441]:     <apic/>
Nov 09 01:02:48 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:02:48 user nova-compute[74441]:   </features>
Nov 09 01:02:48 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:02:48 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:02:48 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:02:48 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:02:48 user nova-compute[74441]:   </clock>
Nov 09 01:02:48 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:02:48 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:02:48 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:02:48 user nova-compute[74441]:   </cpu>
Nov 09 01:02:48 user nova-compute[74441]:   <devices>
Nov 09 01:02:48 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:02:48 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:02:48 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk"/>
Nov 09 01:02:48 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:02:48 user nova-compute[74441]:     </disk>
Nov 09 01:02:48 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:02:48 user nova-compute[74441]:       <mac address="fa:16:3e:d7:35:97"/>
Nov 09 01:02:48 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:02:48 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:02:48 user nova-compute[74441]:       <target dev="tap65db9fd8-e6"/>
Nov 09 01:02:48 user nova-compute[74441]:     </interface>
Nov 09 01:02:48 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:02:48 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/console.log" append="off"/>
Nov 09 01:02:48 user nova-compute[74441]:     </serial>
Nov 09 01:02:48 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:02:48 user nova-compute[74441]:     <video>
Nov 09 01:02:48 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:02:48 user nova-compute[74441]:     </video>
Nov 09 01:02:48 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:02:48 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:02:48 user nova-compute[74441]:     </rng>
Nov 09 01:02:48 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:02:48 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:02:48 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:02:48 user nova-compute[74441]:     </memballoon>
Nov 09 01:02:48 user nova-compute[74441]:   </devices>
Nov 09 01:02:48 user nova-compute[74441]: </domain>
Nov 09 01:02:48 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG os_vif [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e96a1d2f-03c5-57a5-b7ae-a530132e93c8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65db9fd8-e6, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65db9fd8-e6, col_values=(('qos', UUID('1f737a1c-85f4-43d3-8f22-cac875aa984c')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65db9fd8-e6, col_values=(('external_ids', {'iface-id': '65db9fd8-e6f2-41f5-9bcc-e52d93471f61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:35:97', 'vm-uuid': 'd64a477e-66b2-48b9-886d-ca146148167a'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:48 user nova-compute[74441]: INFO os_vif [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6')
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:02:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No VIF found with MAC fa:16:3e:d7:35:97, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.network.neutron [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updated VIF entry in instance network info cache for port 65db9fd8-e6f2-41f5-9bcc-e52d93471f61. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.network.neutron [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16db09ff-0016-4225-9316-27c0e39e288f req-909a18c2-6c18-4a9b-aac8-69b1eb43facc service nova] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:02:49 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Instance spawned successfully.
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:49 user nova-compute[74441]: INFO nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 09 01:02:49 user nova-compute[74441]: DEBUG nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:02:49 user nova-compute[74441]: INFO nova.compute.manager [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Took 6.19 seconds to build instance.
Nov 09 01:02:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-30b155cc-aa25-4d2e-bc0e-2fd0bba44ae0 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.287s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] No waiting events found dispatching network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:02:50 user nova-compute[74441]: WARNING nova.compute.manager [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received unexpected event network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e for instance with vm_state active and task_state None.
Nov 09 01:02:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:02:50 user nova-compute[74441]: WARNING nova.compute.manager [req-436c50ff-fa33-4cf5-ab95-1a23e410e507 req-3aef7897-72ff-4530-88a1-8f00e7a4d64b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state building and task_state spawning.
Nov 09 01:02:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:02:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance spawned successfully.
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:02:52 user nova-compute[74441]: INFO nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:02:52 user nova-compute[74441]: INFO nova.compute.manager [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Took 6.57 seconds to build instance.
Nov 09 01:02:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0731c51b-d1cf-4a68-ac1b-e8ca064c7dff tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.677s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-324a3c5d-6337-4dff-b176-3651a1c52b60 req-44114fc0-1601-4686-85ba-8ae09defc530 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-324a3c5d-6337-4dff-b176-3651a1c52b60 req-44114fc0-1601-4686-85ba-8ae09defc530 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-324a3c5d-6337-4dff-b176-3651a1c52b60 req-44114fc0-1601-4686-85ba-8ae09defc530 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-324a3c5d-6337-4dff-b176-3651a1c52b60 req-44114fc0-1601-4686-85ba-8ae09defc530 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-324a3c5d-6337-4dff-b176-3651a1c52b60 req-44114fc0-1601-4686-85ba-8ae09defc530 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:02:52 user nova-compute[74441]: WARNING nova.compute.manager [req-324a3c5d-6337-4dff-b176-3651a1c52b60 req-44114fc0-1601-4686-85ba-8ae09defc530 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state active and task_state None.
Nov 09 01:02:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.objects.instance [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-77effffc-fbdd-44c6-9463-011f2c25986c tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.125s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:02:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Creating image(s)
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Ensure instance console log exists: /opt/stack/data/nova/instances/bcdd8b3e-3da6-4fd6-b738-3776dce25273/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Start _get_guest_xml network_info=[{"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bcdd8b3e-3da6-4fd6-b738-3776dce25273', 'attached_at': '', 'detached_at': '', 'volume_id': '6735b743-7c32-4e88-bb56-8d21b3592c8a', 'serial': '6735b743-7c32-4e88-bb56-8d21b3592c8a'}, 'attachment_id': '5fc5e710-be9a-45e8-923c-7d85efebfb2e', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:02:57 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:57 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:02:57 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:02:57 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:02:57 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc57992-a857-432e-b71e-3594130ddb93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:02:57 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6276e1-6e8a-412f-a8bd-02c2b632c384]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a] added
Nov 09 01:02:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b2798e-77dd-4816-9255-e0e4a3a169d7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[555f8697-5229-4d61-82ae-3c71a335f228]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQhvTbkH {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQhvTbkH" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a293455-93b5-473a-b4ea-1dba522e1764]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BQhvTbkH'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2253a669-d809-4e8e-9810-c601e5f9767e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3efa52-166e-46f0-bb62-861e5a6feacb]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:57 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:57 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:02:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c52624-1af0-4f2d-b853-43fb4460921d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]
Nov 09 01:02:58 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.
Nov 09 01:02:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde59baa-3b87-43b6-ac1c-7086b8448c7e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[354613cf-e50c-4c96-aafe-ed32f819a3c8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:58 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:58 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:02:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:02:58 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:02:58 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:02:58 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ceee94-acb0-4e8e-b236-d49ec628327e]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 499d7158-9ed0-44e3-ba68-96ba7574f469 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [{"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-499d7158-9ed0-44e3-ba68-96ba7574f469" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:02:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26531363231656632', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531363231656632', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-906176770',display_name='tempest-TestVolumeBootPattern-server-906176770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-906176770',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-r33v61d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:02:31Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=bcdd8b3e-3da6-4fd6-b738-3776dce25273,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.objects.instance [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'pci_devices' on Instance uuid bcdd8b3e-3da6-4fd6-b738-3776dce25273 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:02:59 user nova-compute[74441]:   <uuid>bcdd8b3e-3da6-4fd6-b738-3776dce25273</uuid>
Nov 09 01:02:59 user nova-compute[74441]:   <name>instance-00000023</name>
Nov 09 01:02:59 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:02:59 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:02:59 user nova-compute[74441]:   <metadata>
Nov 09 01:02:59 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:02:59 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:02:59 user nova-compute[74441]:       <nova:name>tempest-TestVolumeBootPattern-server-906176770</nova:name>
Nov 09 01:02:59 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:02:57</nova:creationTime>
Nov 09 01:02:59 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:02:59 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:02:59 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:02:59 user nova-compute[74441]:       <nova:owner>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:user uuid="d80ab02de6b249c3adecf0597940ea76">tempest-TestVolumeBootPattern-1724241999-project-member</nova:user>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:project uuid="ad9194fd2e7248a2bdbfd3d57f846fed">tempest-TestVolumeBootPattern-1724241999</nova:project>
Nov 09 01:02:59 user nova-compute[74441]:       </nova:owner>
Nov 09 01:02:59 user nova-compute[74441]:       <nova:ports>
Nov 09 01:02:59 user nova-compute[74441]:         <nova:port uuid="7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16">
Nov 09 01:02:59 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 01:02:59 user nova-compute[74441]:         </nova:port>
Nov 09 01:02:59 user nova-compute[74441]:       </nova:ports>
Nov 09 01:02:59 user nova-compute[74441]:     </nova:instance>
Nov 09 01:02:59 user nova-compute[74441]:   </metadata>
Nov 09 01:02:59 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:02:59 user nova-compute[74441]:     <system>
Nov 09 01:02:59 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:02:59 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:02:59 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:02:59 user nova-compute[74441]:       <entry name="serial">bcdd8b3e-3da6-4fd6-b738-3776dce25273</entry>
Nov 09 01:02:59 user nova-compute[74441]:       <entry name="uuid">bcdd8b3e-3da6-4fd6-b738-3776dce25273</entry>
Nov 09 01:02:59 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:02:59 user nova-compute[74441]:     </system>
Nov 09 01:02:59 user nova-compute[74441]:   </sysinfo>
Nov 09 01:02:59 user nova-compute[74441]:   <os>
Nov 09 01:02:59 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:02:59 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:02:59 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:02:59 user nova-compute[74441]:   </os>
Nov 09 01:02:59 user nova-compute[74441]:   <features>
Nov 09 01:02:59 user nova-compute[74441]:     <acpi/>
Nov 09 01:02:59 user nova-compute[74441]:     <apic/>
Nov 09 01:02:59 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:02:59 user nova-compute[74441]:   </features>
Nov 09 01:02:59 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:02:59 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:02:59 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:02:59 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:02:59 user nova-compute[74441]:   </clock>
Nov 09 01:02:59 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:02:59 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:02:59 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:02:59 user nova-compute[74441]:   </cpu>
Nov 09 01:02:59 user nova-compute[74441]:   <devices>
Nov 09 01:02:59 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:02:59 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:02:59 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 01:02:59 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:02:59 user nova-compute[74441]:       <serial>6735b743-7c32-4e88-bb56-8d21b3592c8a</serial>
Nov 09 01:02:59 user nova-compute[74441]:     </disk>
Nov 09 01:02:59 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:02:59 user nova-compute[74441]:       <mac address="fa:16:3e:7d:26:b3"/>
Nov 09 01:02:59 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:02:59 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:02:59 user nova-compute[74441]:       <target dev="tap7c6b8aa8-d8"/>
Nov 09 01:02:59 user nova-compute[74441]:     </interface>
Nov 09 01:02:59 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:02:59 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/bcdd8b3e-3da6-4fd6-b738-3776dce25273/console.log" append="off"/>
Nov 09 01:02:59 user nova-compute[74441]:     </serial>
Nov 09 01:02:59 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:02:59 user nova-compute[74441]:     <video>
Nov 09 01:02:59 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:02:59 user nova-compute[74441]:     </video>
Nov 09 01:02:59 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:02:59 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:02:59 user nova-compute[74441]:     </rng>
Nov 09 01:02:59 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:02:59 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:02:59 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:02:59 user nova-compute[74441]:     </memballoon>
Nov 09 01:02:59 user nova-compute[74441]:   </devices>
Nov 09 01:02:59 user nova-compute[74441]: </domain>
Nov 09 01:02:59 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-906176770',display_name='tempest-TestVolumeBootPattern-server-906176770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-906176770',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-r33v61d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:02:31Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=bcdd8b3e-3da6-4fd6-b738-3776dce25273,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG os_vif [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c71b7fc-4549-50ce-b80f-f023ed4d14dd', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c6b8aa8-d8, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c6b8aa8-d8, col_values=(('qos', UUID('4b2d42ea-8c76-4d49-9ece-d03f746ab56c')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c6b8aa8-d8, col_values=(('external_ids', {'iface-id': '7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:26:b3', 'vm-uuid': 'bcdd8b3e-3da6-4fd6-b738-3776dce25273'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:02:59 user nova-compute[74441]: INFO os_vif [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8')
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:02:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No VIF found with MAC fa:16:3e:7d:26:b3, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:03:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-5892dfbb-5179-4987-84bf-6a1aefa2d229 req-05af8d94-43c5-4b36-a18c-0c58a401a324 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5892dfbb-5179-4987-84bf-6a1aefa2d229 req-05af8d94-43c5-4b36-a18c-0c58a401a324 service nova] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5892dfbb-5179-4987-84bf-6a1aefa2d229 req-05af8d94-43c5-4b36-a18c-0c58a401a324 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5892dfbb-5179-4987-84bf-6a1aefa2d229 req-05af8d94-43c5-4b36-a18c-0c58a401a324 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-5892dfbb-5179-4987-84bf-6a1aefa2d229 req-05af8d94-43c5-4b36-a18c-0c58a401a324 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] No waiting events found dispatching network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:01 user nova-compute[74441]: WARNING nova.compute.manager [req-5892dfbb-5179-4987-84bf-6a1aefa2d229 req-05af8d94-43c5-4b36-a18c-0c58a401a324 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received unexpected event network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 for instance with vm_state building and task_state spawning.
Nov 09 01:03:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:03:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Instance spawned successfully.
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:03:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:03:03 user nova-compute[74441]: INFO nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 09 01:03:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:03:03 user nova-compute[74441]: INFO nova.compute.manager [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Took 32.59 seconds to build instance.
Nov 09 01:03:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-525f3d2f-2400-4f30-8d10-250af52c5b17 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.720s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-1f31efae-46c7-4e85-b07d-ae8dbdd567ac req-d1649fb5-c60f-4fe3-9719-2934b4d85246 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1f31efae-46c7-4e85-b07d-ae8dbdd567ac req-d1649fb5-c60f-4fe3-9719-2934b4d85246 service nova] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1f31efae-46c7-4e85-b07d-ae8dbdd567ac req-d1649fb5-c60f-4fe3-9719-2934b4d85246 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1f31efae-46c7-4e85-b07d-ae8dbdd567ac req-d1649fb5-c60f-4fe3-9719-2934b4d85246 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-1f31efae-46c7-4e85-b07d-ae8dbdd567ac req-d1649fb5-c60f-4fe3-9719-2934b4d85246 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] No waiting events found dispatching network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:03 user nova-compute[74441]: WARNING nova.compute.manager [req-1f31efae-46c7-4e85-b07d-ae8dbdd567ac req-d1649fb5-c60f-4fe3-9719-2934b4d85246 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received unexpected event network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 for instance with vm_state active and task_state None.
Nov 09 01:03:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:13 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:03:13 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=24.964275360107422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:13 user nova-compute[74441]: INFO nova.compute.manager [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Rescuing
Nov 09 01:03:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquired lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance ef0e47ba-765a-456e-b9ea-6b7239c86820 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bf7c7bb1-037c-48a9-9673-b358578fa4eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bcdd8b3e-3da6-4fd6-b738-3776dce25273 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:03:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Releasing lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-46b17bfc-8a9e-4992-80c8-3f81222f5402 req-0a57d2d8-9af6-4c5b-b6d2-13c1b6853165 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46b17bfc-8a9e-4992-80c8-3f81222f5402 req-0a57d2d8-9af6-4c5b-b6d2-13c1b6853165 service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46b17bfc-8a9e-4992-80c8-3f81222f5402 req-0a57d2d8-9af6-4c5b-b6d2-13c1b6853165 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-46b17bfc-8a9e-4992-80c8-3f81222f5402 req-0a57d2d8-9af6-4c5b-b6d2-13c1b6853165 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-46b17bfc-8a9e-4992-80c8-3f81222f5402 req-0a57d2d8-9af6-4c5b-b6d2-13c1b6853165 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:14 user nova-compute[74441]: WARNING nova.compute.manager [req-46b17bfc-8a9e-4992-80c8-3f81222f5402 req-0a57d2d8-9af6-4c5b-b6d2-13c1b6853165 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state active and task_state rescuing.
Nov 09 01:03:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance destroyed successfully.
Nov 09 01:03:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Attempting a stable device rescue
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74441) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance directory exists: not creating {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 01:03:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Creating image(s)
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "/opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "/opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG nova.objects.instance [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "4dd66ce250ee13a6c422daf973cb8b4da619aa61" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "4dd66ce250ee13a6c422daf973cb8b4da619aa61" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.part --force-share --output=json" returned: 0 in 0.225s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.virt.images [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] bd58250c-082f-493c-afce-9f065d24b6fe was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.part /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.part /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.converted" returned: 0 in 0.297s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-50e349b0-cf11-440c-97ae-ea2c168a0777 req-76d000d1-1e32-488f-a9cb-e8df1fb3109f service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-50e349b0-cf11-440c-97ae-ea2c168a0777 req-76d000d1-1e32-488f-a9cb-e8df1fb3109f service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-50e349b0-cf11-440c-97ae-ea2c168a0777 req-76d000d1-1e32-488f-a9cb-e8df1fb3109f service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-50e349b0-cf11-440c-97ae-ea2c168a0777 req-76d000d1-1e32-488f-a9cb-e8df1fb3109f service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-50e349b0-cf11-440c-97ae-ea2c168a0777 req-76d000d1-1e32-488f-a9cb-e8df1fb3109f service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:16 user nova-compute[74441]: WARNING nova.compute.manager [req-50e349b0-cf11-440c-97ae-ea2c168a0777 req-76d000d1-1e32-488f-a9cb-e8df1fb3109f service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state active and task_state rescuing.
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "4dd66ce250ee13a6c422daf973cb8b4da619aa61" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.722s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "4dd66ce250ee13a6c422daf973cb8b4da619aa61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "4dd66ce250ee13a6c422daf973cb8b4da619aa61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61 --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61,backing_fmt=raw /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61,backing_fmt=raw /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue" returned: 0 in 0.049s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "4dd66ce250ee13a6c422daf973cb8b4da619aa61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.objects.instance [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'migration_context' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.objects.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Object Instance<1a31fa46-141c-4685-9c9b-abf78eb549f9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Start _get_guest_xml network_info=[{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "vif_mac": "fa:16:3e:a3:74:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bd58250c-082f-493c-afce-9f065d24b6fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1a31fa46-141c-4685-9c9b-abf78eb549f9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2fed908-bbff-4c17-ad25-5b69d384b087', 'serial': 'b2fed908-bbff-4c17-ad25-5b69d384b087'}, 'attachment_id': '021c4fe1-1291-479a-8e77-330f6267a062', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.objects.instance [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'resources' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.objects.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Object Instance<1a31fa46-141c-4685-9c9b-abf78eb549f9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:03:16 user nova-compute[74441]: DEBUG nova.objects.instance [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'numa_topology' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.objects.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Object Instance<1a31fa46-141c-4685-9c9b-abf78eb549f9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:03:17 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:03:17 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.objects.instance [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.objects.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Object Instance<1a31fa46-141c-4685-9c9b-abf78eb549f9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:03:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:03:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:03:17 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef4f17-9348-4509-b2b5-4044ba0cf048]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = KJFOLzBW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 01:03:17 user nova-compute[74441]: node.name = iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:03:17 user nova-compute[74441]: node.tpgt = -1
Nov 09 01:03:17 user nova-compute[74441]: node.startup = automatic
Nov 09 01:03:17 user nova-compute[74441]: node.leading_login = No
Nov 09 01:03:17 user nova-compute[74441]: iface.iscsi_ifacename = default
Nov 09 01:03:17 user nova-compute[74441]: iface.net_ifacename = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.ipaddress = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.prefix_len = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.hwaddress = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.transport_name = tcp
Nov 09 01:03:17 user nova-compute[74441]: iface.initiatorname = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.vlan_id = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.vlan_priority = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.vlan_state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.iface_num = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.mtu = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.port = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.bootproto = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.subnet_mask = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.gateway = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_alt_client_id = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_dns = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_learn_iqn = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_vendor_id_state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_vendor_id = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.dhcp_slp_da = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.fragmentation = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.gratuitous_arp = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.incoming_forwarding = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.tos_state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.tos = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.ttl = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.delayed_ack = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.tcp_nagle = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.tcp_wsf_state = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.tcp_wsf = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.tcp_timer_scale = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.tcp_timestamp = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.redirect = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.def_task_mgmt_timeout = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.header_digest = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.data_digest = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.immediate_data = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.initial_r2t = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.data_seq_inorder = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.data_pdu_inorder = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.erl = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.max_receive_data_len = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.first_burst_len = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.max_outstanding_r2t = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.max_burst_len = 0
Nov 09 01:03:17 user nova-compute[74441]: iface.chap_auth = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.bidi_chap = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.strict_login_compliance = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.discovery_auth = <empty>
Nov 09 01:03:17 user nova-compute[74441]: iface.discovery_logout = <empty>
Nov 09 01:03:17 user nova-compute[74441]: node.discovery_address = <empty>
Nov 09 01:03:17 user nova-compute[74441]: node.discovery_port = 0
Nov 09 01:03:17 user nova-compute[74441]: node.discovery_type = static
Nov 09 01:03:17 user nova-compute[74441]: node.session.initial_cmdsn = 0
Nov 09 01:03:17 user nova-compute[74441]: node.session.initial_login_retry_max = 8
Nov 09 01:03:17 user nova-compute[74441]: node.session.xmit_thread_priority = -20
Nov 09 01:03:17 user nova-compute[74441]: node.session.cmds_max = 128
Nov 09 01:03:17 user nova-compute[74441]: node.session.queue_depth = 32
Nov 09 01:03:17 user nova-compute[74441]: node.session.nr_sessions = 1
Nov 09 01:03:17 user nova-compute[74441]: node.session.auth.authmethod = CHAP
Nov 09 01:03:17 user nova-compute[74441]: node.session.auth.username = KJFOLzBW
Nov 09 01:03:17 user nova-compute[74441]: node.session.auth.password = ***
Nov 09 01:03:17 user nova-compute[74441]: node.session.auth.username_in = <empty>
Nov 09 01:03:17 user nova-compute[74441]: node.session.auth.password_in = <empty>
Nov 09 01:03:17 user nova-compute[74441]: node.session.auth.chap_algs = MD5
Nov 09 01:03:17 user nova-compute[74441]: node.session.timeo.replacement_timeout = 120
Nov 09 01:03:17 user nova-compute[74441]: node.session.err_timeo.abort_timeout = 15
Nov 09 01:03:17 user nova-compute[74441]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 01:03:17 user nova-compute[74441]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 01:03:17 user nova-compute[74441]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.FastAbort = Yes
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.InitialR2T = No
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.ImmediateData = Yes
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.MaxConnections = 1
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 01:03:17 user nova-compute[74441]: node.session.iscsi.ERL = 0
Nov 09 01:03:17 user nova-compute[74441]: node.session.scan = manual
Nov 09 01:03:17 user nova-compute[74441]: node.session.reopen_max = 0
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].address = 172.16.0.220
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].port = 3260
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].startup = manual
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].tcp.window_size = 524288
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].tcp.type_of_service = 0
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].timeo.logout_timeout = 15
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].timeo.login_timeout = 15
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].timeo.auth_timeout = 45
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].iscsi.DataDigest = None
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].iscsi.IFMarker = No
Nov 09 01:03:17 user nova-compute[74441]: node.conn[0].iscsi.OFMarker = No
Nov 09 01:03:17 user nova-compute[74441]: # END RECORD
Nov 09 01:03:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc7f24-b496-45d2-84b9-ad9504c6825a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a754c75-777f-4c68-8e27-3981e27cfdd2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJFOLzBW {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJFOLzBW" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e17149-7512-43e4-a52c-feae688c334e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJFOLzBW'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3563d1-6205-4a81-abe8-09b64087705b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b148e8a-f550-4872-9831-813ae22fd7e0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:03:17 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:03:17 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:03:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:03:17 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:03:17 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:03:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74b5145-1386-4ceb-b520-4ac9c98e7297]: (4, ('0 0 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '23562643861316239', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562643861316239', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643861038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643861038',id=33,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:01:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-lv0x5x23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:01:26Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=1a31fa46-141c-4685-9c9b-abf78eb549f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "vif_mac": "fa:16:3e:a3:74:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "vif_mac": "fa:16:3e:a3:74:97"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.objects.instance [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.objects.base [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Object Instance<1a31fa46-141c-4685-9c9b-abf78eb549f9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:03:17 user nova-compute[74441]:   <uuid>1a31fa46-141c-4685-9c9b-abf78eb549f9</uuid>
Nov 09 01:03:17 user nova-compute[74441]:   <name>instance-00000021</name>
Nov 09 01:03:17 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:03:17 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:03:17 user nova-compute[74441]:   <metadata>
Nov 09 01:03:17 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:03:17 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:03:17 user nova-compute[74441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1643861038</nova:name>
Nov 09 01:03:17 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:03:17</nova:creationTime>
Nov 09 01:03:17 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:03:17 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:03:17 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:03:17 user nova-compute[74441]:       <nova:owner>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:user uuid="ffa1084de0be460fa924e3f124e47a21">tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member</nova:user>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:project uuid="aaf77bd26a3e4bb1831823704242a3b6">tempest-ServerBootFromVolumeStableRescueTest-1850620491</nova:project>
Nov 09 01:03:17 user nova-compute[74441]:       </nova:owner>
Nov 09 01:03:17 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:03:17 user nova-compute[74441]:       <nova:ports>
Nov 09 01:03:17 user nova-compute[74441]:         <nova:port uuid="add2e353-4f48-4a42-8eee-955da3ff6b11">
Nov 09 01:03:17 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 01:03:17 user nova-compute[74441]:         </nova:port>
Nov 09 01:03:17 user nova-compute[74441]:       </nova:ports>
Nov 09 01:03:17 user nova-compute[74441]:     </nova:instance>
Nov 09 01:03:17 user nova-compute[74441]:   </metadata>
Nov 09 01:03:17 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:03:17 user nova-compute[74441]:     <system>
Nov 09 01:03:17 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:03:17 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:03:17 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:03:17 user nova-compute[74441]:       <entry name="serial">1a31fa46-141c-4685-9c9b-abf78eb549f9</entry>
Nov 09 01:03:17 user nova-compute[74441]:       <entry name="uuid">1a31fa46-141c-4685-9c9b-abf78eb549f9</entry>
Nov 09 01:03:17 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:03:17 user nova-compute[74441]:     </system>
Nov 09 01:03:17 user nova-compute[74441]:   </sysinfo>
Nov 09 01:03:17 user nova-compute[74441]:   <os>
Nov 09 01:03:17 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:03:17 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:03:17 user nova-compute[74441]:   </os>
Nov 09 01:03:17 user nova-compute[74441]:   <features>
Nov 09 01:03:17 user nova-compute[74441]:     <acpi/>
Nov 09 01:03:17 user nova-compute[74441]:     <apic/>
Nov 09 01:03:17 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:03:17 user nova-compute[74441]:   </features>
Nov 09 01:03:17 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:03:17 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:03:17 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:03:17 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:03:17 user nova-compute[74441]:   </clock>
Nov 09 01:03:17 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:03:17 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:03:17 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:03:17 user nova-compute[74441]:   </cpu>
Nov 09 01:03:17 user nova-compute[74441]:   <devices>
Nov 09 01:03:17 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:03:17 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:03:17 user nova-compute[74441]:       <source dev="/dev/sdc"/>
Nov 09 01:03:17 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:03:17 user nova-compute[74441]:       <serial>b2fed908-bbff-4c17-ad25-5b69d384b087</serial>
Nov 09 01:03:17 user nova-compute[74441]:     </disk>
Nov 09 01:03:17 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:03:17 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:03:17 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue"/>
Nov 09 01:03:17 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 01:03:17 user nova-compute[74441]:       <boot order="1"/>
Nov 09 01:03:17 user nova-compute[74441]:     </disk>
Nov 09 01:03:17 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:03:17 user nova-compute[74441]:       <mac address="fa:16:3e:a3:74:97"/>
Nov 09 01:03:17 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:03:17 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:03:17 user nova-compute[74441]:       <target dev="tapadd2e353-4f"/>
Nov 09 01:03:17 user nova-compute[74441]:     </interface>
Nov 09 01:03:17 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:03:17 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/console.log" append="off"/>
Nov 09 01:03:17 user nova-compute[74441]:     </serial>
Nov 09 01:03:17 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:03:17 user nova-compute[74441]:     <video>
Nov 09 01:03:17 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:03:17 user nova-compute[74441]:     </video>
Nov 09 01:03:17 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:03:17 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:03:17 user nova-compute[74441]:     </rng>
Nov 09 01:03:17 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:03:17 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:03:17 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:03:17 user nova-compute[74441]:     </memballoon>
Nov 09 01:03:17 user nova-compute[74441]:   </devices>
Nov 09 01:03:17 user nova-compute[74441]: </domain>
Nov 09 01:03:17 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:03:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance destroyed successfully.
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:03:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No VIF found with MAC fa:16:3e:a3:74:97, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-74e2d55d-3984-41bf-ab25-783f3856e1f8 req-7ca875eb-2983-4d94-a431-fa257647ebda service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-74e2d55d-3984-41bf-ab25-783f3856e1f8 req-7ca875eb-2983-4d94-a431-fa257647ebda service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-74e2d55d-3984-41bf-ab25-783f3856e1f8 req-7ca875eb-2983-4d94-a431-fa257647ebda service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-74e2d55d-3984-41bf-ab25-783f3856e1f8 req-7ca875eb-2983-4d94-a431-fa257647ebda service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-74e2d55d-3984-41bf-ab25-783f3856e1f8 req-7ca875eb-2983-4d94-a431-fa257647ebda service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:18 user nova-compute[74441]: WARNING nova.compute.manager [req-74e2d55d-3984-41bf-ab25-783f3856e1f8 req-7ca875eb-2983-4d94-a431-fa257647ebda service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state active and task_state rescuing.
Nov 09 01:03:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:19 user nova-compute[74441]: INFO nova.compute.manager [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attaching volume 2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 to /dev/vdb
Nov 09 01:03:20 user nova-compute[74441]: DEBUG os_brick.utils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c55f82-1fe4-475b-8b2e-ebb41ed770b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e34c4-d621-46b4-bfc3-e88199ddedd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f9ff4-7668-46c1-88e9-ce9382d52d27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8ee9b-64b6-417b-bb0c-a45a96b65705]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:03:20 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45c0bc-3882-4074-9818-76530429fc06]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG os_brick.utils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating existing volume attachment record: 754d0f9c-e881-46a5-abd8-264d0c079bc2 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:20 user nova-compute[74441]: INFO nova.compute.manager [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Terminating instance
Nov 09 01:03:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-848245e3-3e51-4be4-bf64-782754bcfb88 req-3b9ac01b-fda2-47d6-9403-df42d25afad4 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-unplugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-848245e3-3e51-4be4-bf64-782754bcfb88 req-3b9ac01b-fda2-47d6-9403-df42d25afad4 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-848245e3-3e51-4be4-bf64-782754bcfb88 req-3b9ac01b-fda2-47d6-9403-df42d25afad4 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-848245e3-3e51-4be4-bf64-782754bcfb88 req-3b9ac01b-fda2-47d6-9403-df42d25afad4 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-848245e3-3e51-4be4-bf64-782754bcfb88 req-3b9ac01b-fda2-47d6-9403-df42d25afad4 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-unplugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-848245e3-3e51-4be4-bf64-782754bcfb88 req-3b9ac01b-fda2-47d6-9403-df42d25afad4 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-unplugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-90b87186-3907-457c-820a-f42d40bf833b tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-a7005bfc-857e-461f-bccf-d02a3dfcb788 req-de45da53-0e86-4025-a655-e3f34cb4a7e3 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7005bfc-857e-461f-bccf-d02a3dfcb788 req-de45da53-0e86-4025-a655-e3f34cb4a7e3 service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7005bfc-857e-461f-bccf-d02a3dfcb788 req-de45da53-0e86-4025-a655-e3f34cb4a7e3 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a7005bfc-857e-461f-bccf-d02a3dfcb788 req-de45da53-0e86-4025-a655-e3f34cb4a7e3 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-a7005bfc-857e-461f-bccf-d02a3dfcb788 req-de45da53-0e86-4025-a655-e3f34cb4a7e3 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:21 user nova-compute[74441]: WARNING nova.compute.manager [req-a7005bfc-857e-461f-bccf-d02a3dfcb788 req-de45da53-0e86-4025-a655-e3f34cb4a7e3 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state active and task_state rescuing.
Nov 09 01:03:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Instance destroyed successfully.
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'resources' on Instance uuid b5e4c1f2-f309-48b5-93aa-2bfdb8f31856 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656089628',display_name='tempest-ServerRescueNegativeTestJSON-server-1656089628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656089628',id=19,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:48:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-khe0d14u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:48:07Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=b5e4c1f2-f309-48b5-93aa-2bfdb8f31856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "address": "fa:16:3e:fe:bf:c8", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap125829c5-3b", "ovs_interfaceid": "125829c5-3b93-4c47-8cf7-bb293cc53cd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG os_vif [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap125829c5-3b, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=902b1c27-3fed-4e5e-aa7c-c85d74dab776) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:21 user nova-compute[74441]: INFO os_vif [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:bf:c8,bridge_name='br-int',has_traffic_filtering=True,id=125829c5-3b93-4c47-8cf7-bb293cc53cd1,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap125829c5-3b')
Nov 09 01:03:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Deleting instance files /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856_del
Nov 09 01:03:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Deletion of /opt/stack/data/nova/instances/b5e4c1f2-f309-48b5-93aa-2bfdb8f31856_del complete
Nov 09 01:03:21 user nova-compute[74441]: INFO nova.compute.manager [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 09 01:03:21 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:03:21 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:03:22 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Took 0.72 seconds to deallocate network for instance.
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:22 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Deleted allocations for instance b5e4c1f2-f309-48b5-93aa-2bfdb8f31856
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b9403965-8fe5-4884-9397-bdfa5a4bf37f tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-296db311-14c2-4798-affa-f74c314cf196 req-c0c5a57e-c602-40a3-a775-ee3c68f36ec7 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-296db311-14c2-4798-affa-f74c314cf196 req-c0c5a57e-c602-40a3-a775-ee3c68f36ec7 service nova] Acquiring lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-296db311-14c2-4798-affa-f74c314cf196 req-c0c5a57e-c602-40a3-a775-ee3c68f36ec7 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-296db311-14c2-4798-affa-f74c314cf196 req-c0c5a57e-c602-40a3-a775-ee3c68f36ec7 service nova] Lock "b5e4c1f2-f309-48b5-93aa-2bfdb8f31856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-296db311-14c2-4798-affa-f74c314cf196 req-c0c5a57e-c602-40a3-a775-ee3c68f36ec7 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] No waiting events found dispatching network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:03:22 user nova-compute[74441]: WARNING nova.compute.manager [req-296db311-14c2-4798-affa-f74c314cf196 req-c0c5a57e-c602-40a3-a775-ee3c68f36ec7 service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received unexpected event network-vif-plugged-125829c5-3b93-4c47-8cf7-bb293cc53cd1 for instance with vm_state deleted and task_state None.
Nov 09 01:03:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-99cd1c41-d55f-4581-9b84-3f00b7d020e3 req-3e7c916a-29ee-4746-8b94-3015442b0a2a service nova] [instance: b5e4c1f2-f309-48b5-93aa-2bfdb8f31856] Received event network-vif-deleted-125829c5-3b93-4c47-8cf7-bb293cc53cd1 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:03:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITicQped', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:03:44 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:03:44 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:03:44 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd5a2d4-a1c4-490c-820c-2dfa2ed2ea5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:03:44 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e8481-1801-4db6-a1c0-464d713e3d5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3] added
Nov 09 01:03:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaad92c-bd99-4cdb-9ced-14e7c908a726]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[754fb8a4-5131-4d43-8d1c-cfe9240a80d5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITicQped {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITicQped" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4126b398-811a-476c-a424-98074d0fccef]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITicQped'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd1b8e3-6835-47a8-be2e-1e724e89d0a7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2b14b-5c4f-4601-8e4b-9896f09eb9d0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:03:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:03:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a831e-b753-4430-b786-2ac96ad8d8c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260]
Nov 09 01:03:44 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260] successful.
Nov 09 01:03:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[271444fa-8fc3-4b5c-b881-ba53d59d6f06]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec13fa-027a-4a96-9f15-0d6299619721]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:03:44 user nova-compute[74441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 (non-flash)
Nov 09 01:03:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cd3b9b-da0c-4baa-83d5-51533f567b65]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:03:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITicQped', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23465326330613332', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465326330613332', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:03:45 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:03:45 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:03:45 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:03:45 user nova-compute[74441]:   <serial>2d3b3737-5826-41f7-8023-ff7fb5f8bbf3</serial>
Nov 09 01:03:45 user nova-compute[74441]: </disk>
Nov 09 01:03:45 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No VIF found with MAC fa:16:3e:45:27:b1, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:03:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a109d955-d38b-4fb5-8ae1-3c6b95803584 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.058s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:03:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:03:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:03:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:48 user nova-compute[74441]: INFO nova.compute.manager [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Detaching volume 2d3b3737-5826-41f7-8023-ff7fb5f8bbf3
Nov 09 01:03:48 user nova-compute[74441]: INFO nova.virt.block_device [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attempting to driver detach volume 2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 from mountpoint /dev/vdb
Nov 09 01:03:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Attempting to detach device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:03:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:03:48 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:03:48 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:03:48 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:03:48 user nova-compute[74441]:   <serial>2d3b3737-5826-41f7-8023-ff7fb5f8bbf3</serial>
Nov 09 01:03:48 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:03:48 user nova-compute[74441]: </disk>
Nov 09 01:03:48 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:03:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config.
Nov 09 01:03:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:03:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:03:48 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:03:48 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:03:48 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:03:48 user nova-compute[74441]:   <serial>2d3b3737-5826-41f7-8023-ff7fb5f8bbf3</serial>
Nov 09 01:03:48 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:03:48 user nova-compute[74441]: </disk>
Nov 09 01:03:48 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:03:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:03:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:57 user nova-compute[74441]: INFO nova.compute.manager [None req-743e9c5c-5eae-4a0c-852c-c55da123a5ae tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Get console output
Nov 09 01:03:57 user nova-compute[74441]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 09 01:03:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [{"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-ef0e47ba-765a-456e-b9ea-6b7239c86820" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:03:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:04:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:04 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 01:04:08 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 is timed out.
Nov 09 01:04:08 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config.
Nov 09 01:04:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITicQped', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:04:08 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b3397-4a6f-4216-8527-a67384eb98ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:04:08 user nova-compute[74441]: No targets found.
Nov 09 01:04:08 user nova-compute[74441]: iSNS:
Nov 09 01:04:08 user nova-compute[74441]: No targets found.
Nov 09 01:04:08 user nova-compute[74441]: STATIC:
Nov 09 01:04:08 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:04:08 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:08 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:08 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3
Nov 09 01:04:08 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:08 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:08 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:04:08 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:08 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:08 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:04:08 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:08 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:08 user nova-compute[74441]: FIRMWARE:
Nov 09 01:04:08 user nova-compute[74441]: No targets found.
Nov 09 01:04:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:04:08 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:04:08 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2719f-2492-4751-a34d-ce0f7ef8d386]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f700b83-a39f-446d-9025-3cff0dee6ab7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:04:08 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:04:08 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:04:08 user nova-compute[74441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 (non-flash)
Nov 09 01:04:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:04:08 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:04:08 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:04:08 user nova-compute[74441]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 (non-flash)
Nov 09 01:04:08 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c644b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6ab5e8-af31-498d-8ce4-daaca55aacfa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa05138-a73d-463e-b80b-06df4a1145d5]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[08248147-e25b-4f39-b1d7-67f16bcb9ff1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0707f7-9de7-4ea5-bf30-13c09dfb9722]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a6a7cd-f82d-4897-a3d0-92bb383bfad1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1dcf69-73d8-4396-b886-9b14fe3b8ffb]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260]
Nov 09 01:04:09 user nova-compute[74441]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3, portal: 172.16.0.220,3260] successful.
Nov 09 01:04:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d3b3737-5826-41f7-8023-ff7fb5f8bbf3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf84441c-613e-47a5-963a-38e0cc2fa0c2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== disconnect_volume: return (324ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:04:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG nova.objects.instance [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-adaa249f-a33b-41ce-bf30-83d50fd8a291 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:11 user nova-compute[74441]: INFO nova.compute.manager [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Terminating instance
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-8fbc0032-8632-4abe-8e21-2608edf13e09 req-baf0726a-269f-4af8-9324-34d2588c3a12 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8fbc0032-8632-4abe-8e21-2608edf13e09 req-baf0726a-269f-4af8-9324-34d2588c3a12 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8fbc0032-8632-4abe-8e21-2608edf13e09 req-baf0726a-269f-4af8-9324-34d2588c3a12 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-8fbc0032-8632-4abe-8e21-2608edf13e09 req-baf0726a-269f-4af8-9324-34d2588c3a12 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-8fbc0032-8632-4abe-8e21-2608edf13e09 req-baf0726a-269f-4af8-9324-34d2588c3a12 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-8fbc0032-8632-4abe-8e21-2608edf13e09 req-baf0726a-269f-4af8-9324-34d2588c3a12 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-unplugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:04:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Instance destroyed successfully.
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lazy-loading 'resources' on Instance uuid ef0e47ba-765a-456e-b9ea-6b7239c86820 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1656914458',display_name='tempest-ServerRescueNegativeTestJSON-server-1656914458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1656914458',id=18,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:51:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b21e08a84834a8eb02dc374bb92b647',ramdisk_id='',reservation_id='r-zooi39sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1883004734',owner_user_name='tempest-ServerRescueNegativeTestJSON-1883004734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:52:59Z,user_data=None,user_id='383f477236d64d908d2a2868166d4107',uuid=ef0e47ba-765a-456e-b9ea-6b7239c86820,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converting VIF {"id": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "address": "fa:16:3e:4c:42:d5", "network": {"id": "52dab766-5b70-4d2d-8a4d-04de4f5b8553", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-714080991-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b21e08a84834a8eb02dc374bb92b647", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b49fc37-2d", "ovs_interfaceid": "4b49fc37-2df4-4265-99be-94e5b5a8aa99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG os_vif [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b49fc37-2d, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39f450c8-e6a4-4594-ab6a-5d55fde92932) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:12 user nova-compute[74441]: INFO os_vif [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:42:d5,bridge_name='br-int',has_traffic_filtering=True,id=4b49fc37-2df4-4265-99be-94e5b5a8aa99,network=Network(52dab766-5b70-4d2d-8a4d-04de4f5b8553),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b49fc37-2d')
Nov 09 01:04:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Deleting instance files /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820_del
Nov 09 01:04:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Deletion of /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820_del complete
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json" returned: 1 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk --force-share --output=json' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:12 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000012, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ef0e47ba-765a-456e-b9ea-6b7239c86820/disk
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:12 user nova-compute[74441]: INFO nova.compute.manager [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:12 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Took 0.49 seconds to deallocate network for instance.
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:04:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:13 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Deleted allocations for instance ef0e47ba-765a-456e-b9ea-6b7239c86820
Nov 09 01:04:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] Acquiring lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] No waiting events found dispatching network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:04:14 user nova-compute[74441]: WARNING nova.compute.manager [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received unexpected event network-vif-plugged-4b49fc37-2df4-4265-99be-94e5b5a8aa99 for instance with vm_state deleted and task_state None.
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-54cfbb4f-956b-4b01-bcf5-fc274bcf4e5d req-7bdbb6ed-ec87-461c-bfc6-29ed92d5b189 service nova] [instance: ef0e47ba-765a-456e-b9ea-6b7239c86820] Received event network-vif-deleted-4b49fc37-2df4-4265-99be-94e5b5a8aa99 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93b793c9-a4d0-48fd-8307-e4025ce8e031 tempest-ServerRescueNegativeTestJSON-1883004734 tempest-ServerRescueNegativeTestJSON-1883004734-project-member] Lock "ef0e47ba-765a-456e-b9ea-6b7239c86820" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:14 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:04:14 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7624MB free_disk=24.890602111816406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance bcdd8b3e-3da6-4fd6-b738-3776dce25273 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:04:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 01:04:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 01:04:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-changed-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Refreshing instance network info cache due to event network-changed-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] Acquiring lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] Acquired lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG nova.network.neutron [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Refreshing network info cache for port 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:23 user nova-compute[74441]: INFO nova.compute.manager [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Terminating instance
Nov 09 01:04:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updated VIF entry in instance network info cache for port 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.network.neutron [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updating instance_info_cache with network_info: [{"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a1ad9ac-70b9-4138-b0f7-d3d47d233067 req-8e761e7e-27d1-46fe-bf55-7662b27a5291 service nova] Releasing lock "refresh_cache-bcdd8b3e-3da6-4fd6-b738-3776dce25273" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:04:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Instance destroyed successfully.
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'resources' on Instance uuid bcdd8b3e-3da6-4fd6-b738-3776dce25273 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-906176770',display_name='tempest-TestVolumeBootPattern-server-906176770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-906176770',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-r33v61d0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:03:03Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=bcdd8b3e-3da6-4fd6-b738-3776dce25273,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "address": "fa:16:3e:7d:26:b3", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c6b8aa8-d8", "ovs_interfaceid": "7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_vif [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c6b8aa8-d8, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b2d42ea-8c76-4d49-9ece-d03f746ab56c) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:24 user nova-compute[74441]: INFO os_vif [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:26:b3,bridge_name='br-int',has_traffic_filtering=True,id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c6b8aa8-d8')
Nov 09 01:04:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:04:24 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52134661-09a2-4c54-8315-30ae99210909]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:04:24 user nova-compute[74441]: No targets found.
Nov 09 01:04:24 user nova-compute[74441]: iSNS:
Nov 09 01:04:24 user nova-compute[74441]: No targets found.
Nov 09 01:04:24 user nova-compute[74441]: STATIC:
Nov 09 01:04:24 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:04:24 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:24 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:24 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:04:24 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:24 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:24 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:04:24 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:24 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:24 user nova-compute[74441]: FIRMWARE:
Nov 09 01:04:24 user nova-compute[74441]: No targets found.
Nov 09 01:04:24 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:04:24 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:04:24 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44d21d9-16bd-42f2-a3bc-6b8881cc6b58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1048fa66-3623-4447-bbce-c7b0a480389d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:04:24 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:04:24 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:04:24 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:04:24 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:04:24 user nova-compute[74441]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:04:24 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c4d1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2912d1-b096-4bc6-8c97-7f9e92d4700d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ef5cf-0274-434f-af08-421ba3e599c2]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f41ec2-288c-466a-aeec-9d150a5ca000]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:04:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cf854d-6965-4918-8030-67f958c15526]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3c753e-5800-4230-abbd-805a97ed06df]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dba18e-7759-4a79-8ea5-ce4e60c9d306]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]
Nov 09 01:04:25 user nova-compute[74441]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.
Nov 09 01:04:25 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ebde0d-d83e-429f-bdb7-ecd2b1258456]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== disconnect_volume: return (374ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:04:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Deleting instance files /opt/stack/data/nova/instances/bcdd8b3e-3da6-4fd6-b738-3776dce25273_del
Nov 09 01:04:25 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Deletion of /opt/stack/data/nova/instances/bcdd8b3e-3da6-4fd6-b738-3776dce25273_del complete
Nov 09 01:04:25 user nova-compute[74441]: INFO nova.compute.manager [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-vif-unplugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] No waiting events found dispatching network-vif-unplugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-vif-unplugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] Acquiring lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] No waiting events found dispatching network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:04:25 user nova-compute[74441]: WARNING nova.compute.manager [req-7a5600e9-392c-4f3c-b2d5-2004b1012412 req-c4a6e788-2053-417d-aef5-1bd42a09e5b4 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received unexpected event network-vif-plugged-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 for instance with vm_state active and task_state deleting.
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:25 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Took 0.78 seconds to deallocate network for instance.
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-83dadc0f-e13b-415b-adf7-9d68b9613e55 req-596eff4a-abb6-41e1-b638-6a5f48880692 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Received event network-vif-deleted-7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:25 user nova-compute[74441]: INFO nova.compute.manager [req-83dadc0f-e13b-415b-adf7-9d68b9613e55 req-596eff4a-abb6-41e1-b638-6a5f48880692 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Neutron deleted interface 7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16; detaching it from the instance and deleting it from the info cache
Nov 09 01:04:25 user nova-compute[74441]: DEBUG nova.network.neutron [req-83dadc0f-e13b-415b-adf7-9d68b9613e55 req-596eff4a-abb6-41e1-b638-6a5f48880692 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-83dadc0f-e13b-415b-adf7-9d68b9613e55 req-596eff4a-abb6-41e1-b638-6a5f48880692 service nova] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Detach interface failed, port_id=7c6b8aa8-d861-4dd8-8d2a-d8dcef69ff16, reason: Instance bcdd8b3e-3da6-4fd6-b738-3776dce25273 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:04:26 user nova-compute[74441]: INFO nova.compute.manager [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: bcdd8b3e-3da6-4fd6-b738-3776dce25273] Took 0.95 seconds to detach 1 volumes for instance.
Nov 09 01:04:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:27 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:04:27 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:04:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:27 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Deleted allocations for instance bcdd8b3e-3da6-4fd6-b738-3776dce25273
Nov 09 01:04:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3c7f4de2-d0d5-4fcd-b911-00c3067b7c1b tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "bcdd8b3e-3da6-4fd6-b738-3776dce25273" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-changed-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG nova.compute.manager [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Refreshing instance network info cache due to event network-changed-84b14b0f-58c9-4df8-952c-dabfea940a4e. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] Acquiring lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] Acquired lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Refreshing network info cache for port 84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updated VIF entry in instance network info cache for port 84b14b0f-58c9-4df8-952c-dabfea940a4e. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG nova.network.neutron [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updating instance_info_cache with network_info: [{"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:04:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f8f2cbca-d373-47dc-9732-09f83cb21887 req-3a97b526-0581-44dc-8992-2175699cf27b service nova] Releasing lock "refresh_cache-0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-changed-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Refreshing instance network info cache due to event network-changed-65db9fd8-e6f2-41f5-9bcc-e52d93471f61. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Refreshing network info cache for port 65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updated VIF entry in instance network info cache for port 65db9fd8-e6f2-41f5-9bcc-e52d93471f61. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d97602c-1773-43d7-a25d-c8a9b600fdb7 req-a5ba6464-0c11-4a96-bd7b-6c27bf64223b service nova] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:04:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:41 user nova-compute[74441]: INFO nova.compute.manager [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Attaching volume 64cea1c9-664d-4136-82e6-7af3571ccf61 to /dev/vdb
Nov 09 01:04:41 user nova-compute[74441]: DEBUG os_brick.utils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ae4874-2575-44ac-8722-b9395d46fa36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ec8d2-fda3-47b0-abd3-6d795b39f75e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f65e60-daca-4a2f-9dd9-3cb00796ba67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a4b4f-eafa-4607-84d3-edefcf03d61c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:41 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:04:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b10c5e-482b-4378-9409-eafc92abb7a6]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG os_brick.utils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:04:41 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updating existing volume attachment record: 79263414-e596-479b-aea7-f975c1a2bd92 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:04:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 499d7158-9ed0-44e3-ba68-96ba7574f469 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG nova.objects.instance [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:45 user nova-compute[74441]: INFO nova.compute.manager [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Attaching volume 1973bafa-4051-412d-8fa0-ddbde478b590 to /dev/vdb
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG nova.objects.instance [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG os_brick.utils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ea5f4-c6c7-465c-991f-47d0c80c3b76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[69922791-348e-42b2-9738-a82f42d7e170]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[537fb41a-ed58-490f-9807-76e903ab3d0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3708784-5864-40ff-bf64-acda79d558bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:45 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a06211-2ce9-4496-aef9-da76deb7edfa]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG os_brick.utils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating existing volume attachment record: 14cbb8a0-8d92-4671-adf3-d19c4d8edf8f {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:45 user nova-compute[74441]: INFO nova.compute.manager [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attaching volume 9caa46fe-cb60-41d8-a970-d0fc49ca4642 to /dev/vdb
Nov 09 01:04:46 user nova-compute[74441]: DEBUG os_brick.utils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[95308797-8649-47a7-9f15-d5a47352a844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[126dcadc-9a84-4653-b2bd-ce64b76b9f52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[070c6c89-1881-46e5-b7a5-d80b29fd0716]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[230321a0-cd03-458e-af88-b08dba303a9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:04:46 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:04:46 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b7e1ff-0338-4948-ab28-f192121df7af]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG os_brick.utils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:04:46 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating existing volume attachment record: f58f9116-88dc-4e9c-becd-ca2c74f82578 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:04:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:58 user nova-compute[74441]: INFO nova.compute.manager [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Terminating instance
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-85bbd0df-a7e9-496d-adaa-0b0e18d2d2bf req-46ba91f5-6ef4-4a5f-8cb2-af4520b12642 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-unplugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-85bbd0df-a7e9-496d-adaa-0b0e18d2d2bf req-46ba91f5-6ef4-4a5f-8cb2-af4520b12642 service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-85bbd0df-a7e9-496d-adaa-0b0e18d2d2bf req-46ba91f5-6ef4-4a5f-8cb2-af4520b12642 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-85bbd0df-a7e9-496d-adaa-0b0e18d2d2bf req-46ba91f5-6ef4-4a5f-8cb2-af4520b12642 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-85bbd0df-a7e9-496d-adaa-0b0e18d2d2bf req-46ba91f5-6ef4-4a5f-8cb2-af4520b12642 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-unplugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.compute.manager [req-85bbd0df-a7e9-496d-adaa-0b0e18d2d2bf req-46ba91f5-6ef4-4a5f-8cb2-af4520b12642 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-unplugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updating instance_info_cache with network_info: [{"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:04:58 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Instance destroyed successfully.
Nov 09 01:04:58 user nova-compute[74441]: DEBUG nova.objects.instance [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'resources' on Instance uuid 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1396576025',display_name='tempest-ServerActionsTestOtherA-server-1396576025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1396576025',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:00:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-nndelj3e',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:02:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "56411d66-37db-4073-959a-01c9c64508e9", "address": "fa:16:3e:f1:f8:8c", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56411d66-37", "ovs_interfaceid": "56411d66-37db-4073-959a-01c9c64508e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_vif [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56411d66-37, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a340e02-faf6-4f7d-8401-ae01d0d5148e) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:04:59 user nova-compute[74441]: INFO os_vif [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:f8:8c,bridge_name='br-int',has_traffic_filtering=True,id=56411d66-37db-4073-959a-01c9c64508e9,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56411d66-37')
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qJuviVZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:04:59 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[26233f27-0f01-4a4b-ac5d-55324e1acd56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:04:59 user nova-compute[74441]: No targets found.
Nov 09 01:04:59 user nova-compute[74441]: iSNS:
Nov 09 01:04:59 user nova-compute[74441]: No targets found.
Nov 09 01:04:59 user nova-compute[74441]: STATIC:
Nov 09 01:04:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124
Nov 09 01:04:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:59 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:04:59 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:04:59 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:04:59 user nova-compute[74441]: FIRMWARE:
Nov 09 01:04:59 user nova-compute[74441]: No targets found.
Nov 09 01:04:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:04:59 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:04:59 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8ff219-dd78-4b96-b7c3-7f4a2a073827]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31f9077-42ea-4812-82c2-ed9e866863b1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:04:59 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:04:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 (non-flash)
Nov 09 01:04:59 user nova-compute[74441]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:04:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c581990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124'): ({'sdf'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Removing single pathed devices sdf {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7008631-eab0-4af9-a74e-153f569a0609]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4269548-95ab-4c07-96fa-e412462ddc8d]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Flushing IO for device /dev/sdf {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[017165ab-a129-4f83-a300-2558d9bcb4e3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9895c531-f102-41b5-a04a-8b30b452490e]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dffb92c4', '/dev/disk/by-id/scsi-1SCST_BIOdffb92c4-f327eab7b5162c24', '/dev/disk/by-id/scsi-26633323765616237') {{(pid=85292) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e0be2-236e-4fcd-b29a-ee1c47e82e37]: (4, None) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71936a7-fa98-440c-911c-41809cbf08f4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c1682-07d5-4607-8b1d-b244ae014518]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260]
Nov 09 01:04:59 user nova-compute[74441]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124, portal: 172.16.0.220,3260] successful.
Nov 09 01:04:59 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c314dc54-4f09-43d1-9850-df397db83124 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3092c55d-7c15-4596-b838-73a94e45da91]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] <== disconnect_volume: return (341ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:04:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Deleting instance files /opt/stack/data/nova/instances/53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38_del
Nov 09 01:04:59 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Deletion of /opt/stack/data/nova/instances/53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38_del complete
Nov 09 01:04:59 user nova-compute[74441]: INFO nova.compute.manager [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 09 01:04:59 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:04:59 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:05:00 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Took 0.87 seconds to deallocate network for instance.
Nov 09 01:05:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-62ca399b-222e-4170-9c27-bba1f26807c3 req-6f0913e4-834e-4a56-bba2-9d0b842b5643 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-deleted-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:00 user nova-compute[74441]: INFO nova.compute.manager [req-62ca399b-222e-4170-9c27-bba1f26807c3 req-6f0913e4-834e-4a56-bba2-9d0b842b5643 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Neutron deleted interface 56411d66-37db-4073-959a-01c9c64508e9; detaching it from the instance and deleting it from the info cache
Nov 09 01:05:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-62ca399b-222e-4170-9c27-bba1f26807c3 req-6f0913e4-834e-4a56-bba2-9d0b842b5643 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-62ca399b-222e-4170-9c27-bba1f26807c3 req-6f0913e4-834e-4a56-bba2-9d0b842b5643 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Detach interface failed, port_id=56411d66-37db-4073-959a-01c9c64508e9, reason: Instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-beadf1dc-48a2-49a5-97f7-7e828b35551d req-093b230b-bb17-4411-ae96-57b997cf4c80 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-beadf1dc-48a2-49a5-97f7-7e828b35551d req-093b230b-bb17-4411-ae96-57b997cf4c80 service nova] Acquiring lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-beadf1dc-48a2-49a5-97f7-7e828b35551d req-093b230b-bb17-4411-ae96-57b997cf4c80 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-beadf1dc-48a2-49a5-97f7-7e828b35551d req-093b230b-bb17-4411-ae96-57b997cf4c80 service nova] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-beadf1dc-48a2-49a5-97f7-7e828b35551d req-093b230b-bb17-4411-ae96-57b997cf4c80 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] No waiting events found dispatching network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:00 user nova-compute[74441]: WARNING nova.compute.manager [req-beadf1dc-48a2-49a5-97f7-7e828b35551d req-093b230b-bb17-4411-ae96-57b997cf4c80 service nova] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Received unexpected event network-vif-plugged-56411d66-37db-4073-959a-01c9c64508e9 for instance with vm_state active and task_state deleting.
Nov 09 01:05:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:04 user nova-compute[74441]: INFO nova.compute.manager [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Unrescuing
Nov 09 01:05:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:05:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquired lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:05:04 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:05:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Releasing lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'flavor' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-48987bef-23a4-4349-a9eb-f8a174c00f2e req-0ae49096-4e75-4137-a9ba-10ef1edca897 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-48987bef-23a4-4349-a9eb-f8a174c00f2e req-0ae49096-4e75-4137-a9ba-10ef1edca897 service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-48987bef-23a4-4349-a9eb-f8a174c00f2e req-0ae49096-4e75-4137-a9ba-10ef1edca897 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-48987bef-23a4-4349-a9eb-f8a174c00f2e req-0ae49096-4e75-4137-a9ba-10ef1edca897 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-48987bef-23a4-4349-a9eb-f8a174c00f2e req-0ae49096-4e75-4137-a9ba-10ef1edca897 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:05 user nova-compute[74441]: WARNING nova.compute.manager [req-48987bef-23a4-4349-a9eb-f8a174c00f2e req-0ae49096-4e75-4137-a9ba-10ef1edca897 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:05:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance destroyed successfully.
Nov 09 01:05:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlSHVCMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:05:07 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:07 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:07 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[459dc283-8a2c-46cb-a2b2-7e0166da01b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:05:07 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712534a-bc52-4bce-82fa-32f8764bc7f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61] added
Nov 09 01:05:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f969bfb4-10ba-4f09-8803-6f2a1ef35e4b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18480fe-aaa9-4c93-8ba2-86541b365b0d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlSHVCMJ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YlSHVCMJ" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[723f8fdd-3ae9-4f9d-ab8f-926d02615609]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YlSHVCMJ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dbf7d8-5760-407e-b819-e2fd38137ee4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b20141b-531c-4313-b35c-f71d5485f2a1]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b2c548-af42-4ffd-8c9d-4aeaf92bbce6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260]
Nov 09 01:05:07 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260] successful.
Nov 09 01:05:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd3fbb-cf37-451c-a0ef-5f3a0569c567]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40efeaca-09df-436a-905c-9a53a19e68fe]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:07 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:07 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2bf69f-6802-423c-810b-fbc8c6bf38ed]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlSHVCMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:07 user nova-compute[74441]: WARNING nova.compute.manager [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:05:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:07 user nova-compute[74441]: DEBUG nova.compute.manager [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:07 user nova-compute[74441]: WARNING nova.compute.manager [req-93f239f1-6a01-4600-8a59-3f87e4ff5828 req-ad45d770-d0a5-4f30-b510-70f85f627fad service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:05:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:08 user nova-compute[74441]: INFO nova.compute.manager [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Took 7.91 seconds to detach 1 volumes for instance.
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38] Deleting volume: c314dc54-4f09-43d1-9850-df397db83124 {{(pid=74441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23236623031383730', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236623031383730', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:05:08 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:08 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:05:08 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:08 user nova-compute[74441]:   <serial>64cea1c9-664d-4136-82e6-7af3571ccf61</serial>
Nov 09 01:05:08 user nova-compute[74441]: </disk>
Nov 09 01:05:08 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:05:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:9b:09:c4, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e12d36f4-5070-403f-9576-a259d97eaf16 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.880s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 25.015s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:09 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Deleted allocations for instance 53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-12cb97fd-6732-4609-81df-0c8eacf33f4c tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "53c5e6b6-3fd1-4968-bdc8-2417e5bbdb38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.255s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9d2b25ab-294e-4bd7-bf62-867a360000a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-2eaa9c24-d9a3-4b7d-83fc-e550c9c62c82 req-4d512fb6-fd14-4651-aa1c-7a01174a3dcf service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2eaa9c24-d9a3-4b7d-83fc-e550c9c62c82 req-4d512fb6-fd14-4651-aa1c-7a01174a3dcf service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2eaa9c24-d9a3-4b7d-83fc-e550c9c62c82 req-4d512fb6-fd14-4651-aa1c-7a01174a3dcf service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2eaa9c24-d9a3-4b7d-83fc-e550c9c62c82 req-4d512fb6-fd14-4651-aa1c-7a01174a3dcf service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-2eaa9c24-d9a3-4b7d-83fc-e550c9c62c82 req-4d512fb6-fd14-4651-aa1c-7a01174a3dcf service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:09 user nova-compute[74441]: WARNING nova.compute.manager [req-2eaa9c24-d9a3-4b7d-83fc-e550c9c62c82 req-4d512fb6-fd14-4651-aa1c-7a01174a3dcf service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state rescued and task_state unrescuing.
Nov 09 01:05:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:05:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:10 user nova-compute[74441]: INFO nova.compute.manager [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Detaching volume 64cea1c9-664d-4136-82e6-7af3571ccf61
Nov 09 01:05:10 user nova-compute[74441]: INFO nova.virt.block_device [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Attempting to driver detach volume 64cea1c9-664d-4136-82e6-7af3571ccf61 from mountpoint /dev/vdb
Nov 09 01:05:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Attempting to detach device vdb from instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:05:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:05:10 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:10 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:05:10 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:10 user nova-compute[74441]:   <serial>64cea1c9-664d-4136-82e6-7af3571ccf61</serial>
Nov 09 01:05:10 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:05:10 user nova-compute[74441]: </disk>
Nov 09 01:05:10 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:05:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully detached device vdb from instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 from the persistent domain config.
Nov 09 01:05:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:05:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:05:10 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:10 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:05:10 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:10 user nova-compute[74441]:   <serial>64cea1c9-664d-4136-82e6-7af3571ccf61</serial>
Nov 09 01:05:10 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:05:10 user nova-compute[74441]: </disk>
Nov 09 01:05:10 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:05:11 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:11 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:11 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c123e4-bb8a-4273-83f9-94b21db9d71c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:05:11 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64f55fb-df74-4c65-9f55-57696bd77822]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590] added
Nov 09 01:05:11 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b44a00-4dd8-4b34-8b40-83b3d9dd81f8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba234b67-f281-4b8e-8687-19d679607b69]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWiDgRSJ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWiDgRSJ" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d3870-6ec3-46b2-b076-2d225502c3eb]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWiDgRSJ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:11 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed1a2a3-bfd0-44cb-9123-3e4cc37b54b7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d7de2c-c0e0-4992-91d7-0f4e4914f414]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32e416-93a8-4949-8c69-ef5043c505f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]
Nov 09 01:05:12 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.
Nov 09 01:05:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6afa203-aa35-4a75-a480-fd396faf983c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdeac15-4f8f-4e40-ac07-ee0eb55cc27b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed667db0-cc47-4045-ab3d-229218d7f3c5]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '26236383664373532', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236383664373532', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.objects.instance [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:05:13 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:13 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:05:13 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:13 user nova-compute[74441]:   <serial>1973bafa-4051-412d-8fa0-ddbde478b590</serial>
Nov 09 01:05:13 user nova-compute[74441]: </disk>
Nov 09 01:05:13 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:13 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:05:13 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8157MB free_disk=24.91616439819336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No VIF found with MAC fa:16:3e:d7:35:97, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:05:13 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-736c1144-9579-4c68-8837-6421064912f1 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.398s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74441) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-4052d1b7-a9c2-4eac-9565-2d10a304d01a req-6e22db96-b472-43c0-b49b-5224f5dc45fa service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4052d1b7-a9c2-4eac-9565-2d10a304d01a req-6e22db96-b472-43c0-b49b-5224f5dc45fa service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4052d1b7-a9c2-4eac-9565-2d10a304d01a req-6e22db96-b472-43c0-b49b-5224f5dc45fa service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4052d1b7-a9c2-4eac-9565-2d10a304d01a req-6e22db96-b472-43c0-b49b-5224f5dc45fa service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-4052d1b7-a9c2-4eac-9565-2d10a304d01a req-6e22db96-b472-43c0-b49b-5224f5dc45fa service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:14 user nova-compute[74441]: WARNING nova.compute.manager [req-4052d1b7-a9c2-4eac-9565-2d10a304d01a req-6e22db96-b472-43c0-b49b-5224f5dc45fa service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state active and task_state powering-off.
Nov 09 01:05:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance destroyed successfully.
Nov 09 01:05:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:05:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8d76eebe-1347-4237-9a3d-b69d7b28698b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.107s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:05:16 user nova-compute[74441]: INFO nova.compute.claims [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Claim successful on node user
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:05:16 user nova-compute[74441]: DEBUG nova.network.neutron [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:05:16 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:05:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG nova.policy [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd80ab02de6b249c3adecf0597940ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9194fd2e7248a2bdbfd3d57f846fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:05:17 user nova-compute[74441]: INFO nova.virt.block_device [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Booting with volume 6735b743-7c32-4e88-bb56-8d21b3592c8a at /dev/vda
Nov 09 01:05:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-a15575df-6987-428e-9b83-6de1b754239b req-cd44f75b-d2bf-4109-a2c4-e2377a045815 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a15575df-6987-428e-9b83-6de1b754239b req-cd44f75b-d2bf-4109-a2c4-e2377a045815 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a15575df-6987-428e-9b83-6de1b754239b req-cd44f75b-d2bf-4109-a2c4-e2377a045815 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a15575df-6987-428e-9b83-6de1b754239b req-cd44f75b-d2bf-4109-a2c4-e2377a045815 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-a15575df-6987-428e-9b83-6de1b754239b req-cd44f75b-d2bf-4109-a2c4-e2377a045815 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:05:17 user nova-compute[74441]: WARNING nova.compute.manager [req-a15575df-6987-428e-9b83-6de1b754239b req-cd44f75b-d2bf-4109-a2c4-e2377a045815 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state stopped and task_state None.
Nov 09 01:05:17 user nova-compute[74441]: DEBUG os_brick.utils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f266216c-4889-4f48-98af-ade61ca1a171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048d836-b0ea-4fb1-9d7b-aa35f6bd9dd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91060c98-c068-4aad-9b40-5b10e52f2f49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9144882-2204-4bef-b881-70b2650b2cbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:05:17 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:05:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a3a7c-e1ea-4cdd-983b-c0668abdb552]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG os_brick.utils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:05:17 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updating existing volume attachment record: 904f5ad9-4272-4b3a-b681-8a90209ba4eb {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Successfully created port: 9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Successfully updated port: 9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquired lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-changed-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Refreshing instance network info cache due to event network-changed-9afac105-0e2a-412c-b715-a90e4ae4aa76. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] Acquiring lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:05:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updating instance_info_cache with network_info: [{"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Releasing lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Instance network_info: |[{"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] Acquired lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Refreshing network info cache for port 9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updated VIF entry in instance network info cache for port 9afac105-0e2a-412c-b715-a90e4ae4aa76. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG nova.network.neutron [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updating instance_info_cache with network_info: [{"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:05:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-de851f0b-cac3-41da-ad3a-288cdb58af16 req-addf0f16-57c3-4f09-bfd5-12410231acbe service nova] Releasing lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:05:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:05:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:05:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:31 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 is timed out.
Nov 09 01:05:31 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully detached device vdb from instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 from the live domain config.
Nov 09 01:05:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YlSHVCMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:05:31 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba7c288-2519-48b0-8fb3-281f34eee4c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:05:31 user nova-compute[74441]: No targets found.
Nov 09 01:05:31 user nova-compute[74441]: iSNS:
Nov 09 01:05:31 user nova-compute[74441]: No targets found.
Nov 09 01:05:31 user nova-compute[74441]: STATIC:
Nov 09 01:05:31 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590
Nov 09 01:05:31 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:05:31 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:05:31 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61
Nov 09 01:05:31 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:05:31 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:05:31 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:05:31 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:05:31 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:05:31 user nova-compute[74441]: FIRMWARE:
Nov 09 01:05:31 user nova-compute[74441]: No targets found.
Nov 09 01:05:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:05:31 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:05:31 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f881b4-2cd5-434f-96fb-7bcd6b842d06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d315be63-ab2b-4eec-8112-f03d43458977]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:31 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:31 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:31 user nova-compute[74441]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 (non-flash)
Nov 09 01:05:31 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c49c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd8a43-b399-40c6-966e-f2d248e8d066]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441b5f1-94c5-4ccb-9722-7475aa7dac4b]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed6eb41-09ab-4783-ba6c-9834530f5794]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab682fa-1dbf-40ce-8559-3a2080ee4a11]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1dd60b-b2a1-40f7-90e4-6f82d69ef05d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b03888-2973-4c11-9c01-de6f0be0588c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260]
Nov 09 01:05:31 user nova-compute[74441]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61, portal: 172.16.0.220,3260] successful.
Nov 09 01:05:31 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64cea1c9-664d-4136-82e6-7af3571ccf61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ef9bdb-b639-4287-b2a0-804fad4f9d09]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== disconnect_volume: return (329ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:05:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViahtKLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:05:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:32 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3e04b2-311d-4f63-a868-b142c705b4a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:05:32 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9569ec8f-2e80-4476-8ad9-467ef5792f36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642] added
Nov 09 01:05:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9fe70f-1ae2-43c1-9f3f-8318f7fb4e80]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c5cff5-aa2c-4e8c-8869-9d6c0772382e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViahtKLc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ViahtKLc" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61e316-2447-48fb-a5c6-20842a13ca2c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ViahtKLc'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12da0be-a6c9-4093-9152-283faa2c4640]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7052dd37-a550-4b11-8c4d-693ce5230b24]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34409d6-b964-47f2-a9d3-e86ae70c04ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260]
Nov 09 01:05:32 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260] successful.
Nov 09 01:05:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e20803-bc4a-4dca-a48b-0b240e9b75dd]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b63b8cb-b23a-4fd7-829b-bd1789768756]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 (non-flash)
Nov 09 01:05:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031d471-e319-4fa0-8189-b900ff74a2c4]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:05:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8cc769bf-a188-4f73-9619-8e7137905340 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.477s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViahtKLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23962353566353137', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962353566353137', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG nova.objects.instance [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:05:33 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:33 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:05:33 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:33 user nova-compute[74441]:   <serial>9caa46fe-cb60-41d8-a970-d0fc49ca4642</serial>
Nov 09 01:05:33 user nova-compute[74441]: </disk>
Nov 09 01:05:33 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] No VIF found with MAC fa:16:3e:45:27:b1, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:05:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae3f4eae-f8cc-41c9-845e-d6ccda363a76 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.366s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:05:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:05:36 user nova-compute[74441]: INFO nova.compute.manager [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Detaching volume 9caa46fe-cb60-41d8-a970-d0fc49ca4642
Nov 09 01:05:36 user nova-compute[74441]: INFO nova.virt.block_device [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Attempting to driver detach volume 9caa46fe-cb60-41d8-a970-d0fc49ca4642 from mountpoint /dev/vdb
Nov 09 01:05:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Attempting to detach device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:05:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:05:36 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:36 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:05:36 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:36 user nova-compute[74441]:   <serial>9caa46fe-cb60-41d8-a970-d0fc49ca4642</serial>
Nov 09 01:05:36 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:05:36 user nova-compute[74441]: </disk>
Nov 09 01:05:36 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:05:36 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the persistent domain config.
Nov 09 01:05:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:05:36 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:05:36 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:05:36 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:05:36 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:05:36 user nova-compute[74441]:   <serial>9caa46fe-cb60-41d8-a970-d0fc49ca4642</serial>
Nov 09 01:05:36 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:05:36 user nova-compute[74441]: </disk>
Nov 09 01:05:36 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:05:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:05:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:05:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:57 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 is timed out.
Nov 09 01:05:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully detached device vdb from instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 from the live domain config.
Nov 09 01:05:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ViahtKLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:05:57 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[71336add-3677-4ca9-b3fb-c853f64e1014]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:05:57 user nova-compute[74441]: No targets found.
Nov 09 01:05:57 user nova-compute[74441]: iSNS:
Nov 09 01:05:57 user nova-compute[74441]: No targets found.
Nov 09 01:05:57 user nova-compute[74441]: STATIC:
Nov 09 01:05:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642
Nov 09 01:05:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:05:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:05:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590
Nov 09 01:05:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:05:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:05:57 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:05:57 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:05:57 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:05:57 user nova-compute[74441]: FIRMWARE:
Nov 09 01:05:57 user nova-compute[74441]: No targets found.
Nov 09 01:05:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:05:57 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:05:57 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f4af4e-d57e-4bbd-937f-850ca48765c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[356dad52-e33c-4225-af25-80f4174347f6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:57 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:57 user nova-compute[74441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 (non-flash)
Nov 09 01:05:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:05:57 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:05:57 user nova-compute[74441]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 (non-flash)
Nov 09 01:05:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c138b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde2d813-7c0b-469e-81e5-9c45c2ea4b12]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e524038-085b-4b1b-ab74-2b0b0885be4d]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e16811-7957-4a4c-8c9e-c4bc93d3e0e1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c83fa-80e8-461a-ba27-40ff8e69af9e]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b6354-732b-4e84-a063-f64391d2d54c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[514fcc56-5848-4f26-8630-585be40aed76]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260]
Nov 09 01:05:57 user nova-compute[74441]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642, portal: 172.16.0.220,3260] successful.
Nov 09 01:05:57 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9caa46fe-cb60-41d8-a970-d0fc49ca4642 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f074d210-7dd4-4ccc-b571-2bd64a334003]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] <== disconnect_volume: return (309ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:05:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:05:58 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'flavor' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:05:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2c114ff8-38b4-48e1-a938-7db8106d475d tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating instance_info_cache with network_info: [{"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:05:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:00 user nova-compute[74441]: INFO nova.compute.manager [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Terminating instance
Nov 09 01:06:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8a5f62b-ed3e-4b52-a631-21ef002108a4 req-8c0f637b-125a-4cbb-b362-f36d0b2a3839 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-vif-unplugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8a5f62b-ed3e-4b52-a631-21ef002108a4 req-8c0f637b-125a-4cbb-b362-f36d0b2a3839 service nova] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8a5f62b-ed3e-4b52-a631-21ef002108a4 req-8c0f637b-125a-4cbb-b362-f36d0b2a3839 service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a8a5f62b-ed3e-4b52-a631-21ef002108a4 req-8c0f637b-125a-4cbb-b362-f36d0b2a3839 service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8a5f62b-ed3e-4b52-a631-21ef002108a4 req-8c0f637b-125a-4cbb-b362-f36d0b2a3839 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] No waiting events found dispatching network-vif-unplugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-a8a5f62b-ed3e-4b52-a631-21ef002108a4 req-8c0f637b-125a-4cbb-b362-f36d0b2a3839 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-vif-unplugged-84b14b0f-58c9-4df8-952c-dabfea940a4e for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Instance destroyed successfully.
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.objects.instance [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'resources' on Instance uuid 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-718415875',display_name='tempest-AttachVolumeNegativeTest-server-718415875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-718415875',id=36,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENqpFrPokQCe07976akbCbTjXUuAQ3e94nnkjgOGavaPUlAMTGnVZtzKx19QJG/XuUKTimIZ32FIor8kPRyuRoZPzhCBAx+lFSLeTHFZBLXwoDG44DBHAbmbaii8GJFGg==',key_name='tempest-keypair-186690860',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-kvq1rjf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=0dbaa8c6-468d-4c8b-ad95-58466c0bbe05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "address": "fa:16:3e:9b:09:c4", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b14b0f-58", "ovs_interfaceid": "84b14b0f-58c9-4df8-952c-dabfea940a4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG os_vif [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84b14b0f-58, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aefa19c-d633-421c-b2f2-a418f8bde91c) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:01 user nova-compute[74441]: INFO os_vif [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:09:c4,bridge_name='br-int',has_traffic_filtering=True,id=84b14b0f-58c9-4df8-952c-dabfea940a4e,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b14b0f-58')
Nov 09 01:06:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Deleting instance files /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05_del
Nov 09 01:06:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Deletion of /opt/stack/data/nova/instances/0dbaa8c6-468d-4c8b-ad95-58466c0bbe05_del complete
Nov 09 01:06:01 user nova-compute[74441]: INFO nova.compute.manager [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 09 01:06:01 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:06:01 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:06:02 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Took 0.76 seconds to deallocate network for instance.
Nov 09 01:06:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-0821fe47-181c-4ebb-bd9b-41dcbf5294c2 req-81313d4e-55d6-430f-aa06-29046d282471 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-vif-deleted-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:06:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:02 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Deleted allocations for instance 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05
Nov 09 01:06:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-d4cde7d3-a23d-4123-99db-8e74e75fc685 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-27c9b27f-2b9e-41de-8fd0-525d64908149 req-7095d4e8-ffb7-4e6c-b77d-20532925df84 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received event network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-27c9b27f-2b9e-41de-8fd0-525d64908149 req-7095d4e8-ffb7-4e6c-b77d-20532925df84 service nova] Acquiring lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-27c9b27f-2b9e-41de-8fd0-525d64908149 req-7095d4e8-ffb7-4e6c-b77d-20532925df84 service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-27c9b27f-2b9e-41de-8fd0-525d64908149 req-7095d4e8-ffb7-4e6c-b77d-20532925df84 service nova] Lock "0dbaa8c6-468d-4c8b-ad95-58466c0bbe05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-27c9b27f-2b9e-41de-8fd0-525d64908149 req-7095d4e8-ffb7-4e6c-b77d-20532925df84 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] No waiting events found dispatching network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:06:03 user nova-compute[74441]: WARNING nova.compute.manager [req-27c9b27f-2b9e-41de-8fd0-525d64908149 req-7095d4e8-ffb7-4e6c-b77d-20532925df84 service nova] [instance: 0dbaa8c6-468d-4c8b-ad95-58466c0bbe05] Received unexpected event network-vif-plugged-84b14b0f-58c9-4df8-952c-dabfea940a4e for instance with vm_state deleted and task_state None.
Nov 09 01:06:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:07 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:06:09 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Creating image(s)
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Ensure instance console log exists: /opt/stack/data/nova/instances/19f2dd9e-c2f4-4117-a53d-109679326aee/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Start _get_guest_xml network_info=[{"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '19f2dd9e-c2f4-4117-a53d-109679326aee', 'attached_at': '', 'detached_at': '', 'volume_id': '6735b743-7c32-4e88-bb56-8d21b3592c8a', 'serial': '6735b743-7c32-4e88-bb56-8d21b3592c8a'}, 'attachment_id': '904f5ad9-4272-4b3a-b681-8a90209ba4eb', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:06:09 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:06:09 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:06:09 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:06:09 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:06:09 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad7ee8a-cea7-4ec1-9c45-03d0c7aae3ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:06:09 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2955891-4d98-4f0e-9711-f28f134a5742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a] added
Nov 09 01:06:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e96eb61-933f-42c5-8f3f-bb60ca03b38c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82bfcb-aeb5-43c9-81ff-669933f9342b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQhvTbkH {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BQhvTbkH" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0610fd-c196-4285-ac6f-a8ff63dd2a35]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BQhvTbkH'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e5baf-5375-4387-b96b-9255419d500b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbb8519-ac6d-4d31-9b08-ac2b19e97470]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2db30-adb9-471a-b1aa-dd90dfaf0339]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]
Nov 09 01:06:09 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.
Nov 09 01:06:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b550cb9e-973b-4ac8-a1a7-38bd66246d6d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c01fec4-d2a5-42af-a9ec-54fedb3fb73d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:06:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:06:09 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:06:09 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:06:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:10 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4265e9f8-7e0a-48c0-a677-f914cfe89e8c]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:06:10 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:06:10 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26531363231656632', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531363231656632', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487033461',display_name='tempest-TestVolumeBootPattern-server-487033461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487033461',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-7pnacq87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:05:17Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=19f2dd9e-c2f4-4117-a53d-109679326aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'pci_devices' on Instance uuid 19f2dd9e-c2f4-4117-a53d-109679326aee {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:06:11 user nova-compute[74441]:   <uuid>19f2dd9e-c2f4-4117-a53d-109679326aee</uuid>
Nov 09 01:06:11 user nova-compute[74441]:   <name>instance-00000026</name>
Nov 09 01:06:11 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:06:11 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:06:11 user nova-compute[74441]:   <metadata>
Nov 09 01:06:11 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:06:11 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:06:11 user nova-compute[74441]:       <nova:name>tempest-TestVolumeBootPattern-server-487033461</nova:name>
Nov 09 01:06:11 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:06:09</nova:creationTime>
Nov 09 01:06:11 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:06:11 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:06:11 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:06:11 user nova-compute[74441]:       <nova:owner>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:user uuid="d80ab02de6b249c3adecf0597940ea76">tempest-TestVolumeBootPattern-1724241999-project-member</nova:user>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:project uuid="ad9194fd2e7248a2bdbfd3d57f846fed">tempest-TestVolumeBootPattern-1724241999</nova:project>
Nov 09 01:06:11 user nova-compute[74441]:       </nova:owner>
Nov 09 01:06:11 user nova-compute[74441]:       <nova:ports>
Nov 09 01:06:11 user nova-compute[74441]:         <nova:port uuid="9afac105-0e2a-412c-b715-a90e4ae4aa76">
Nov 09 01:06:11 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 01:06:11 user nova-compute[74441]:         </nova:port>
Nov 09 01:06:11 user nova-compute[74441]:       </nova:ports>
Nov 09 01:06:11 user nova-compute[74441]:     </nova:instance>
Nov 09 01:06:11 user nova-compute[74441]:   </metadata>
Nov 09 01:06:11 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:06:11 user nova-compute[74441]:     <system>
Nov 09 01:06:11 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:06:11 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:06:11 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:06:11 user nova-compute[74441]:       <entry name="serial">19f2dd9e-c2f4-4117-a53d-109679326aee</entry>
Nov 09 01:06:11 user nova-compute[74441]:       <entry name="uuid">19f2dd9e-c2f4-4117-a53d-109679326aee</entry>
Nov 09 01:06:11 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:06:11 user nova-compute[74441]:     </system>
Nov 09 01:06:11 user nova-compute[74441]:   </sysinfo>
Nov 09 01:06:11 user nova-compute[74441]:   <os>
Nov 09 01:06:11 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:06:11 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:06:11 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:06:11 user nova-compute[74441]:   </os>
Nov 09 01:06:11 user nova-compute[74441]:   <features>
Nov 09 01:06:11 user nova-compute[74441]:     <acpi/>
Nov 09 01:06:11 user nova-compute[74441]:     <apic/>
Nov 09 01:06:11 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:06:11 user nova-compute[74441]:   </features>
Nov 09 01:06:11 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:06:11 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:06:11 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:06:11 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:06:11 user nova-compute[74441]:   </clock>
Nov 09 01:06:11 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:06:11 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:06:11 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:06:11 user nova-compute[74441]:   </cpu>
Nov 09 01:06:11 user nova-compute[74441]:   <devices>
Nov 09 01:06:11 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:06:11 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:06:11 user nova-compute[74441]:       <source dev="/dev/sdb"/>
Nov 09 01:06:11 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:06:11 user nova-compute[74441]:       <serial>6735b743-7c32-4e88-bb56-8d21b3592c8a</serial>
Nov 09 01:06:11 user nova-compute[74441]:     </disk>
Nov 09 01:06:11 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:06:11 user nova-compute[74441]:       <mac address="fa:16:3e:00:59:8f"/>
Nov 09 01:06:11 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:06:11 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:06:11 user nova-compute[74441]:       <target dev="tap9afac105-0e"/>
Nov 09 01:06:11 user nova-compute[74441]:     </interface>
Nov 09 01:06:11 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:06:11 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/19f2dd9e-c2f4-4117-a53d-109679326aee/console.log" append="off"/>
Nov 09 01:06:11 user nova-compute[74441]:     </serial>
Nov 09 01:06:11 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:06:11 user nova-compute[74441]:     <video>
Nov 09 01:06:11 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:06:11 user nova-compute[74441]:     </video>
Nov 09 01:06:11 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:06:11 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:06:11 user nova-compute[74441]:     </rng>
Nov 09 01:06:11 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:06:11 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:06:11 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:06:11 user nova-compute[74441]:     </memballoon>
Nov 09 01:06:11 user nova-compute[74441]:   </devices>
Nov 09 01:06:11 user nova-compute[74441]: </domain>
Nov 09 01:06:11 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487033461',display_name='tempest-TestVolumeBootPattern-server-487033461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487033461',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-7pnacq87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:05:17Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=19f2dd9e-c2f4-4117-a53d-109679326aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG os_vif [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33b430c1-bdae-5029-8973-ad07578e6a92', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9afac105-0e, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9afac105-0e, col_values=(('qos', UUID('56c06496-c938-4e42-9a15-51d047016ea5')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9afac105-0e, col_values=(('external_ids', {'iface-id': '9afac105-0e2a-412c-b715-a90e4ae4aa76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:59:8f', 'vm-uuid': '19f2dd9e-c2f4-4117-a53d-109679326aee'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:11 user nova-compute[74441]: INFO os_vif [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e')
Nov 09 01:06:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:06:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No VIF found with MAC fa:16:3e:00:59:8f, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-62b0708c-cea5-4214-b7d8-4f8a75857df4 req-ab584ac5-be1d-4609-98ff-823b17a384df service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-62b0708c-cea5-4214-b7d8-4f8a75857df4 req-ab584ac5-be1d-4609-98ff-823b17a384df service nova] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-62b0708c-cea5-4214-b7d8-4f8a75857df4 req-ab584ac5-be1d-4609-98ff-823b17a384df service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-62b0708c-cea5-4214-b7d8-4f8a75857df4 req-ab584ac5-be1d-4609-98ff-823b17a384df service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-62b0708c-cea5-4214-b7d8-4f8a75857df4 req-ab584ac5-be1d-4609-98ff-823b17a384df service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] No waiting events found dispatching network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:06:12 user nova-compute[74441]: WARNING nova.compute.manager [req-62b0708c-cea5-4214-b7d8-4f8a75857df4 req-ab584ac5-be1d-4609-98ff-823b17a384df service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received unexpected event network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 for instance with vm_state building and task_state spawning.
Nov 09 01:06:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:06:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Instance spawned successfully.
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e9107f7-9438-4301-ab13-ea232e598619 req-0793a7dd-1037-4fb0-b0bf-7efc9c1e2aab service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e9107f7-9438-4301-ab13-ea232e598619 req-0793a7dd-1037-4fb0-b0bf-7efc9c1e2aab service nova] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e9107f7-9438-4301-ab13-ea232e598619 req-0793a7dd-1037-4fb0-b0bf-7efc9c1e2aab service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e9107f7-9438-4301-ab13-ea232e598619 req-0793a7dd-1037-4fb0-b0bf-7efc9c1e2aab service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e9107f7-9438-4301-ab13-ea232e598619 req-0793a7dd-1037-4fb0-b0bf-7efc9c1e2aab service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] No waiting events found dispatching network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:06:14 user nova-compute[74441]: WARNING nova.compute.manager [req-3e9107f7-9438-4301-ab13-ea232e598619 req-0793a7dd-1037-4fb0-b0bf-7efc9c1e2aab service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received unexpected event network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 for instance with vm_state building and task_state spawning.
Nov 09 01:06:14 user nova-compute[74441]: INFO nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:06:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:14 user nova-compute[74441]: INFO nova.compute.manager [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Took 58.47 seconds to build instance.
Nov 09 01:06:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-cd79f598-7cdd-4594-9efd-c900448c992c tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.583s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:16 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:06:16 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8388MB free_disk=24.932872772216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 19f2dd9e-c2f4-4117-a53d-109679326aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:06:16 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:06:17 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:06:17 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:06:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:06:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:06:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:20 user nova-compute[74441]: INFO nova.compute.manager [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Terminating instance
Nov 09 01:06:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:06:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f0ec9930-5dfe-4da7-bc5e-6c9efd74f05a req-ef3eb2ec-688d-41d1-b5cd-696b19521b44 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-vif-unplugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f0ec9930-5dfe-4da7-bc5e-6c9efd74f05a req-ef3eb2ec-688d-41d1-b5cd-696b19521b44 service nova] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f0ec9930-5dfe-4da7-bc5e-6c9efd74f05a req-ef3eb2ec-688d-41d1-b5cd-696b19521b44 service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f0ec9930-5dfe-4da7-bc5e-6c9efd74f05a req-ef3eb2ec-688d-41d1-b5cd-696b19521b44 service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f0ec9930-5dfe-4da7-bc5e-6c9efd74f05a req-ef3eb2ec-688d-41d1-b5cd-696b19521b44 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] No waiting events found dispatching network-vif-unplugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-f0ec9930-5dfe-4da7-bc5e-6c9efd74f05a req-ef3eb2ec-688d-41d1-b5cd-696b19521b44 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-vif-unplugged-184a62e0-be26-4fff-a8f4-927393e2f732 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:06:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Instance destroyed successfully.
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.objects.instance [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lazy-loading 'resources' on Instance uuid 499d7158-9ed0-44e3-ba68-96ba7574f469 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:44:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1454423779',display_name='tempest-ServerActionsTestOtherA-server-1454423779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1454423779',id=16,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgaSC4iudsGAFUUmi/+XVgU1yb1HeeLyBKA7SosEKboCOjLza1H5J1IH3Z+OkYTfmA0JkMMUJpmEgYwBA2Jii/cBiA6aLiPA48nYv3PP6r8+d8ix3xYIu4yjDncvjh3Ww==',key_name='tempest-keypair-975851079',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:44:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24c24e7fc6e24dd0bc5c8ca3bfd1166f',ramdisk_id='',reservation_id='r-dvcmhhgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1357980906',owner_user_name='tempest-ServerActionsTestOtherA-1357980906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dee4ca1b1a8d432d943ba7bf20f41f1b',uuid=499d7158-9ed0-44e3-ba68-96ba7574f469,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converting VIF {"id": "184a62e0-be26-4fff-a8f4-927393e2f732", "address": "fa:16:3e:79:11:53", "network": {"id": "2615cede-e8cc-400a-add2-bddebb0b061b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1937024632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24c24e7fc6e24dd0bc5c8ca3bfd1166f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184a62e0-be", "ovs_interfaceid": "184a62e0-be26-4fff-a8f4-927393e2f732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG os_vif [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap184a62e0-be, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d74d6a8-d1e0-4c62-bb69-dccf7da4d6fd) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:21 user nova-compute[74441]: INFO os_vif [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:11:53,bridge_name='br-int',has_traffic_filtering=True,id=184a62e0-be26-4fff-a8f4-927393e2f732,network=Network(2615cede-e8cc-400a-add2-bddebb0b061b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184a62e0-be')
Nov 09 01:06:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Deleting instance files /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469_del
Nov 09 01:06:21 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Deletion of /opt/stack/data/nova/instances/499d7158-9ed0-44e3-ba68-96ba7574f469_del complete
Nov 09 01:06:21 user nova-compute[74441]: INFO nova.compute.manager [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 01:06:21 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:06:21 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:06:22 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Took 0.44 seconds to deallocate network for instance.
Nov 09 01:06:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-ce705a35-2aa1-4e81-b306-99718cc59665 req-bbce6a23-30c6-4059-a20a-76994ec8ff12 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-vif-deleted-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:22 user nova-compute[74441]: INFO nova.compute.manager [req-ce705a35-2aa1-4e81-b306-99718cc59665 req-bbce6a23-30c6-4059-a20a-76994ec8ff12 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Neutron deleted interface 184a62e0-be26-4fff-a8f4-927393e2f732; detaching it from the instance and deleting it from the info cache
Nov 09 01:06:22 user nova-compute[74441]: DEBUG nova.network.neutron [req-ce705a35-2aa1-4e81-b306-99718cc59665 req-bbce6a23-30c6-4059-a20a-76994ec8ff12 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-ce705a35-2aa1-4e81-b306-99718cc59665 req-bbce6a23-30c6-4059-a20a-76994ec8ff12 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Detach interface failed, port_id=184a62e0-be26-4fff-a8f4-927393e2f732, reason: Instance 499d7158-9ed0-44e3-ba68-96ba7574f469 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:06:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:22 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Deleted allocations for instance 499d7158-9ed0-44e3-ba68-96ba7574f469
Nov 09 01:06:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-edddae17-59ee-461b-889c-1c60bce11c90 tempest-ServerActionsTestOtherA-1357980906 tempest-ServerActionsTestOtherA-1357980906-project-member] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1a8483e8-32a9-486c-986f-a24fdf4543ea req-acf30df0-330b-4fa1-be57-1a7959b7fd08 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received event network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a8483e8-32a9-486c-986f-a24fdf4543ea req-acf30df0-330b-4fa1-be57-1a7959b7fd08 service nova] Acquiring lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a8483e8-32a9-486c-986f-a24fdf4543ea req-acf30df0-330b-4fa1-be57-1a7959b7fd08 service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1a8483e8-32a9-486c-986f-a24fdf4543ea req-acf30df0-330b-4fa1-be57-1a7959b7fd08 service nova] Lock "499d7158-9ed0-44e3-ba68-96ba7574f469-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:23 user nova-compute[74441]: DEBUG nova.compute.manager [req-1a8483e8-32a9-486c-986f-a24fdf4543ea req-acf30df0-330b-4fa1-be57-1a7959b7fd08 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] No waiting events found dispatching network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:06:23 user nova-compute[74441]: WARNING nova.compute.manager [req-1a8483e8-32a9-486c-986f-a24fdf4543ea req-acf30df0-330b-4fa1-be57-1a7959b7fd08 service nova] [instance: 499d7158-9ed0-44e3-ba68-96ba7574f469] Received unexpected event network-vif-plugged-184a62e0-be26-4fff-a8f4-927393e2f732 for instance with vm_state deleted and task_state None.
Nov 09 01:06:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:06:55 user nova-compute[74441]: INFO nova.compute.claims [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Claim successful on node user
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:06:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.policy [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '156577f25fe04e6e8ac3612c2a0dbc4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e49bf75726243749bace44e94c1397b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:06:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Creating image(s)
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "/opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "/opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:55 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.271s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.269s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk 1073741824" returned: 0 in 0.066s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.234s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:06:56 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Cannot resize image /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Ensure instance console log exists: /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Successfully created port: 25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:06:57 user nova-compute[74441]: INFO nova.compute.claims [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Claim successful on node user
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Successfully updated port: 25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquired lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-changed-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Refreshing instance network info cache due to event network-changed-25fe7b32-7327-4f43-b342-eeb0498a90b4. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] Acquiring lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:06:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:06:58 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.policy [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffa1084de0be460fa924e3f124e47a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf77bd26a3e4bb1831823704242a3b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:06:58 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Creating image(s)
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "/opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "/opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updating instance_info_cache with network_info: [{"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Releasing lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Instance network_info: |[{"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] Acquired lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.neutron [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Refreshing network info cache for port 25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Start _get_guest_xml network_info=[{"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:06:58 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:06:58 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1459417391',display_name='tempest-AttachVolumeNegativeTest-server-1459417391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1459417391',id=39,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHWR0TMFceu7LcD450/Jcw25jR81i97tXXyUEiFk2ZemJOdXYNSTs6kw3tI5MwDE0IIY0IBzenbsVQUCE9c09yD8/3UniPzrLswC5PL9vRNpA1lT/YILZ1aaYuc5QyxKw==',key_name='tempest-keypair-1152033868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-gd9tudax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.objects.instance [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'pci_devices' on Instance uuid 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:06:58 user nova-compute[74441]:   <uuid>63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7</uuid>
Nov 09 01:06:58 user nova-compute[74441]:   <name>instance-00000027</name>
Nov 09 01:06:58 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:06:58 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:06:58 user nova-compute[74441]:   <metadata>
Nov 09 01:06:58 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:06:58 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:06:58 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1459417391</nova:name>
Nov 09 01:06:58 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:06:58</nova:creationTime>
Nov 09 01:06:58 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:06:58 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:06:58 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:06:58 user nova-compute[74441]:       <nova:owner>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:user uuid="156577f25fe04e6e8ac3612c2a0dbc4d">tempest-AttachVolumeNegativeTest-595140925-project-member</nova:user>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:project uuid="8e49bf75726243749bace44e94c1397b">tempest-AttachVolumeNegativeTest-595140925</nova:project>
Nov 09 01:06:58 user nova-compute[74441]:       </nova:owner>
Nov 09 01:06:58 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:06:58 user nova-compute[74441]:       <nova:ports>
Nov 09 01:06:58 user nova-compute[74441]:         <nova:port uuid="25fe7b32-7327-4f43-b342-eeb0498a90b4">
Nov 09 01:06:58 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 01:06:58 user nova-compute[74441]:         </nova:port>
Nov 09 01:06:58 user nova-compute[74441]:       </nova:ports>
Nov 09 01:06:58 user nova-compute[74441]:     </nova:instance>
Nov 09 01:06:58 user nova-compute[74441]:   </metadata>
Nov 09 01:06:58 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:06:58 user nova-compute[74441]:     <system>
Nov 09 01:06:58 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:06:58 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:06:58 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:06:58 user nova-compute[74441]:       <entry name="serial">63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7</entry>
Nov 09 01:06:58 user nova-compute[74441]:       <entry name="uuid">63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7</entry>
Nov 09 01:06:58 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:06:58 user nova-compute[74441]:     </system>
Nov 09 01:06:58 user nova-compute[74441]:   </sysinfo>
Nov 09 01:06:58 user nova-compute[74441]:   <os>
Nov 09 01:06:58 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:06:58 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:06:58 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:06:58 user nova-compute[74441]:   </os>
Nov 09 01:06:58 user nova-compute[74441]:   <features>
Nov 09 01:06:58 user nova-compute[74441]:     <acpi/>
Nov 09 01:06:58 user nova-compute[74441]:     <apic/>
Nov 09 01:06:58 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:06:58 user nova-compute[74441]:   </features>
Nov 09 01:06:58 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:06:58 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:06:58 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:06:58 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:06:58 user nova-compute[74441]:   </clock>
Nov 09 01:06:58 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:06:58 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:06:58 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:06:58 user nova-compute[74441]:   </cpu>
Nov 09 01:06:58 user nova-compute[74441]:   <devices>
Nov 09 01:06:58 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:06:58 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:06:58 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk"/>
Nov 09 01:06:58 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:06:58 user nova-compute[74441]:     </disk>
Nov 09 01:06:58 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:06:58 user nova-compute[74441]:       <mac address="fa:16:3e:55:92:6e"/>
Nov 09 01:06:58 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:06:58 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:06:58 user nova-compute[74441]:       <target dev="tap25fe7b32-73"/>
Nov 09 01:06:58 user nova-compute[74441]:     </interface>
Nov 09 01:06:58 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:06:58 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/console.log" append="off"/>
Nov 09 01:06:58 user nova-compute[74441]:     </serial>
Nov 09 01:06:58 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:06:58 user nova-compute[74441]:     <video>
Nov 09 01:06:58 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:06:58 user nova-compute[74441]:     </video>
Nov 09 01:06:58 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:06:58 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:06:58 user nova-compute[74441]:     </rng>
Nov 09 01:06:58 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:06:58 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:06:58 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:06:58 user nova-compute[74441]:     </memballoon>
Nov 09 01:06:58 user nova-compute[74441]:   </devices>
Nov 09 01:06:58 user nova-compute[74441]: </domain>
Nov 09 01:06:58 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1459417391',display_name='tempest-AttachVolumeNegativeTest-server-1459417391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1459417391',id=39,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHWR0TMFceu7LcD450/Jcw25jR81i97tXXyUEiFk2ZemJOdXYNSTs6kw3tI5MwDE0IIY0IBzenbsVQUCE9c09yD8/3UniPzrLswC5PL9vRNpA1lT/YILZ1aaYuc5QyxKw==',key_name='tempest-keypair-1152033868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-gd9tudax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:06:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG os_vif [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79a9d859-718b-504a-9eb4-36d01ad04fb7', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25fe7b32-73, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25fe7b32-73, col_values=(('qos', UUID('1059942b-4658-4a5a-b1eb-fb366424b1c4')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25fe7b32-73, col_values=(('external_ids', {'iface-id': '25fe7b32-7327-4f43-b342-eeb0498a90b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:92:6e', 'vm-uuid': '63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:06:58 user nova-compute[74441]: INFO os_vif [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73')
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk 1073741824" returned: 0 in 0.067s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:55:92:6e, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.neutron [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updated VIF entry in instance network info cache for port 25fe7b32-7327-4f43-b342-eeb0498a90b4. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG nova.network.neutron [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updating instance_info_cache with network_info: [{"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:06:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-aa13eeb3-f2a5-45d3-8cf5-c6bce92c7fab req-1cab1f28-272e-4e4d-ad73-aa0264122ae4 service nova] Releasing lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Successfully created port: 1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Cannot resize image /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Ensure instance console log exists: /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Successfully updated port: 1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "refresh_cache-d7483b9f-709b-4409-88bf-1adc3d51ac90" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquired lock "refresh_cache-d7483b9f-709b-4409-88bf-1adc3d51ac90" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-changed-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Refreshing instance network info cache due to event network-changed-1dfd219b-4826-45f4-a354-4b0353c8d7b3. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] Acquiring lock "refresh_cache-d7483b9f-709b-4409-88bf-1adc3d51ac90" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:06:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Updating instance_info_cache with network_info: [{"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Releasing lock "refresh_cache-d7483b9f-709b-4409-88bf-1adc3d51ac90" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Instance network_info: |[{"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] Acquired lock "refresh_cache-d7483b9f-709b-4409-88bf-1adc3d51ac90" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Refreshing network info cache for port 1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Start _get_guest_xml network_info=[{"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:00 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1783853293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1783853293',id=40,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-bhbgfj90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:06:58Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=d7483b9f-709b-4409-88bf-1adc3d51ac90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'pci_devices' on Instance uuid d7483b9f-709b-4409-88bf-1adc3d51ac90 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:07:00 user nova-compute[74441]:   <uuid>d7483b9f-709b-4409-88bf-1adc3d51ac90</uuid>
Nov 09 01:07:00 user nova-compute[74441]:   <name>instance-00000028</name>
Nov 09 01:07:00 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:07:00 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:07:00 user nova-compute[74441]:   <metadata>
Nov 09 01:07:00 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:07:00 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:07:00 user nova-compute[74441]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1783853293</nova:name>
Nov 09 01:07:00 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:07:00</nova:creationTime>
Nov 09 01:07:00 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:07:00 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:07:00 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:07:00 user nova-compute[74441]:       <nova:owner>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:user uuid="ffa1084de0be460fa924e3f124e47a21">tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member</nova:user>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:project uuid="aaf77bd26a3e4bb1831823704242a3b6">tempest-ServerBootFromVolumeStableRescueTest-1850620491</nova:project>
Nov 09 01:07:00 user nova-compute[74441]:       </nova:owner>
Nov 09 01:07:00 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:07:00 user nova-compute[74441]:       <nova:ports>
Nov 09 01:07:00 user nova-compute[74441]:         <nova:port uuid="1dfd219b-4826-45f4-a354-4b0353c8d7b3">
Nov 09 01:07:00 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 01:07:00 user nova-compute[74441]:         </nova:port>
Nov 09 01:07:00 user nova-compute[74441]:       </nova:ports>
Nov 09 01:07:00 user nova-compute[74441]:     </nova:instance>
Nov 09 01:07:00 user nova-compute[74441]:   </metadata>
Nov 09 01:07:00 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:07:00 user nova-compute[74441]:     <system>
Nov 09 01:07:00 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:07:00 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:07:00 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:07:00 user nova-compute[74441]:       <entry name="serial">d7483b9f-709b-4409-88bf-1adc3d51ac90</entry>
Nov 09 01:07:00 user nova-compute[74441]:       <entry name="uuid">d7483b9f-709b-4409-88bf-1adc3d51ac90</entry>
Nov 09 01:07:00 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:07:00 user nova-compute[74441]:     </system>
Nov 09 01:07:00 user nova-compute[74441]:   </sysinfo>
Nov 09 01:07:00 user nova-compute[74441]:   <os>
Nov 09 01:07:00 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:07:00 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:07:00 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:07:00 user nova-compute[74441]:   </os>
Nov 09 01:07:00 user nova-compute[74441]:   <features>
Nov 09 01:07:00 user nova-compute[74441]:     <acpi/>
Nov 09 01:07:00 user nova-compute[74441]:     <apic/>
Nov 09 01:07:00 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:07:00 user nova-compute[74441]:   </features>
Nov 09 01:07:00 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:07:00 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:07:00 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:07:00 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:07:00 user nova-compute[74441]:   </clock>
Nov 09 01:07:00 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:07:00 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:07:00 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:07:00 user nova-compute[74441]:   </cpu>
Nov 09 01:07:00 user nova-compute[74441]:   <devices>
Nov 09 01:07:00 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:07:00 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:07:00 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk"/>
Nov 09 01:07:00 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:07:00 user nova-compute[74441]:     </disk>
Nov 09 01:07:00 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:07:00 user nova-compute[74441]:       <mac address="fa:16:3e:ee:77:f6"/>
Nov 09 01:07:00 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:07:00 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:07:00 user nova-compute[74441]:       <target dev="tap1dfd219b-48"/>
Nov 09 01:07:00 user nova-compute[74441]:     </interface>
Nov 09 01:07:00 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:07:00 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/console.log" append="off"/>
Nov 09 01:07:00 user nova-compute[74441]:     </serial>
Nov 09 01:07:00 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:07:00 user nova-compute[74441]:     <video>
Nov 09 01:07:00 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:07:00 user nova-compute[74441]:     </video>
Nov 09 01:07:00 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:07:00 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:07:00 user nova-compute[74441]:     </rng>
Nov 09 01:07:00 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:07:00 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:07:00 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:07:00 user nova-compute[74441]:     </memballoon>
Nov 09 01:07:00 user nova-compute[74441]:   </devices>
Nov 09 01:07:00 user nova-compute[74441]: </domain>
Nov 09 01:07:00 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1783853293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1783853293',id=40,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-bhbgfj90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:06:58Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=d7483b9f-709b-4409-88bf-1adc3d51ac90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG os_vif [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242bccee-fd7c-5b82-996e-d8469ef19f73', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dfd219b-48, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dfd219b-48, col_values=(('qos', UUID('a1970e52-1cbb-4f4d-a210-a23935249e6b')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dfd219b-48, col_values=(('external_ids', {'iface-id': '1dfd219b-4826-45f4-a354-4b0353c8d7b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:77:f6', 'vm-uuid': 'd7483b9f-709b-4409-88bf-1adc3d51ac90'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: INFO os_vif [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48')
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-dc9ceb34-a860-4596-bd21-ef9ab9b6cc11 req-85721a43-d392-46a6-b5b4-cedf4538cab3 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dc9ceb34-a860-4596-bd21-ef9ab9b6cc11 req-85721a43-d392-46a6-b5b4-cedf4538cab3 service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dc9ceb34-a860-4596-bd21-ef9ab9b6cc11 req-85721a43-d392-46a6-b5b4-cedf4538cab3 service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dc9ceb34-a860-4596-bd21-ef9ab9b6cc11 req-85721a43-d392-46a6-b5b4-cedf4538cab3 service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-dc9ceb34-a860-4596-bd21-ef9ab9b6cc11 req-85721a43-d392-46a6-b5b4-cedf4538cab3 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:00 user nova-compute[74441]: WARNING nova.compute.manager [req-dc9ceb34-a860-4596-bd21-ef9ab9b6cc11 req-85721a43-d392-46a6-b5b4-cedf4538cab3 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state building and task_state spawning.
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] No VIF found with MAC fa:16:3e:ee:77:f6, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Updated VIF entry in instance network info cache for port 1dfd219b-4826-45f4-a354-4b0353c8d7b3. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Updating instance_info_cache with network_info: [{"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-661738ba-0e4c-40e6-a814-cacefb46c881 req-4aca4662-ad8b-432a-93c2-ba360c6fc1e0 service nova] Releasing lock "refresh_cache-d7483b9f-709b-4409-88bf-1adc3d51ac90" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-2403a172-15f2-4c58-8521-afcb2db5eacb req-f45cc535-bd12-4783-95f8-6b1d0a2c4d8f service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2403a172-15f2-4c58-8521-afcb2db5eacb req-f45cc535-bd12-4783-95f8-6b1d0a2c4d8f service nova] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2403a172-15f2-4c58-8521-afcb2db5eacb req-f45cc535-bd12-4783-95f8-6b1d0a2c4d8f service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2403a172-15f2-4c58-8521-afcb2db5eacb req-f45cc535-bd12-4783-95f8-6b1d0a2c4d8f service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-2403a172-15f2-4c58-8521-afcb2db5eacb req-f45cc535-bd12-4783-95f8-6b1d0a2c4d8f service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] No waiting events found dispatching network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:02 user nova-compute[74441]: WARNING nova.compute.manager [req-2403a172-15f2-4c58-8521-afcb2db5eacb req-f45cc535-bd12-4783-95f8-6b1d0a2c4d8f service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received unexpected event network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 for instance with vm_state building and task_state spawning.
Nov 09 01:07:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-c309e8ac-8622-41ae-aae0-33c84d4a16f1 req-cceefd37-29b9-4eb4-8de2-86c22645dbc9 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c309e8ac-8622-41ae-aae0-33c84d4a16f1 req-cceefd37-29b9-4eb4-8de2-86c22645dbc9 service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c309e8ac-8622-41ae-aae0-33c84d4a16f1 req-cceefd37-29b9-4eb4-8de2-86c22645dbc9 service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c309e8ac-8622-41ae-aae0-33c84d4a16f1 req-cceefd37-29b9-4eb4-8de2-86c22645dbc9 service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-c309e8ac-8622-41ae-aae0-33c84d4a16f1 req-cceefd37-29b9-4eb4-8de2-86c22645dbc9 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:02 user nova-compute[74441]: WARNING nova.compute.manager [req-c309e8ac-8622-41ae-aae0-33c84d4a16f1 req-cceefd37-29b9-4eb4-8de2-86c22645dbc9 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state building and task_state spawning.
Nov 09 01:07:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:07:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Instance spawned successfully.
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: INFO nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Took 8.22 seconds to spawn the instance on the hypervisor.
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-f422a32a-182a-4161-836f-74d853f5c5b9 req-d978f624-20dd-4173-9d25-5f333ee81660 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f422a32a-182a-4161-836f-74d853f5c5b9 req-d978f624-20dd-4173-9d25-5f333ee81660 service nova] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f422a32a-182a-4161-836f-74d853f5c5b9 req-d978f624-20dd-4173-9d25-5f333ee81660 service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f422a32a-182a-4161-836f-74d853f5c5b9 req-d978f624-20dd-4173-9d25-5f333ee81660 service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-f422a32a-182a-4161-836f-74d853f5c5b9 req-d978f624-20dd-4173-9d25-5f333ee81660 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] No waiting events found dispatching network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:04 user nova-compute[74441]: WARNING nova.compute.manager [req-f422a32a-182a-4161-836f-74d853f5c5b9 req-d978f624-20dd-4173-9d25-5f333ee81660 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received unexpected event network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 for instance with vm_state building and task_state spawning.
Nov 09 01:07:04 user nova-compute[74441]: INFO nova.compute.manager [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Took 9.26 seconds to build instance.
Nov 09 01:07:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1330a963-33ed-4b4a-867a-3af4c35a713b tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.385s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:07:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Instance spawned successfully.
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:04 user nova-compute[74441]: INFO nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 09 01:07:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:07:04 user nova-compute[74441]: INFO nova.compute.manager [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Took 7.18 seconds to build instance.
Nov 09 01:07:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5de5f32c-8b52-40db-8b62-f5628fc8ea63 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.372s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'info_cache' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:05 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:07:06 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance destroyed successfully.
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'resources' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65db9fd8-e6, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f737a1c-85f4-43d3-8f22-cac875aa984c) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:06 user nova-compute[74441]: INFO os_vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6')
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:07:06 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dea3b0-62df-42bd-8b8a-d238976f4c5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:07:06 user nova-compute[74441]: No targets found.
Nov 09 01:07:06 user nova-compute[74441]: iSNS:
Nov 09 01:07:06 user nova-compute[74441]: No targets found.
Nov 09 01:07:06 user nova-compute[74441]: STATIC:
Nov 09 01:07:06 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:07:06 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:07:06 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:07:06 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590
Nov 09 01:07:06 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:07:06 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:07:06 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:07:06 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:07:06 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:07:06 user nova-compute[74441]: FIRMWARE:
Nov 09 01:07:06 user nova-compute[74441]: No targets found.
Nov 09 01:07:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:07:06 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:07:06 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a87e8b-134f-4fe6-9f01-efc96f9c4d55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87336a46-b51c-4577-8179-29449b1c1385]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:07:06 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:07:06 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:07:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:07:06 user nova-compute[74441]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:07:06 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:07:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c13acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5694b5-69ee-4c82-8f00-908a505e0e9c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5649084b-8216-4d6a-9672-2104f9106649]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab462ad0-2c91-4e03-b1d6-1d86a6a465fd]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc29883-a4ce-4d7b-a9ca-7ae5b6d057a3]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cebc4d0-9a94-4565-93c6-881d92f95c85]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da7e26b-5d60-444e-ba9d-68d99946d62e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]
Nov 09 01:07:06 user nova-compute[74441]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.
Nov 09 01:07:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff119b-7198-4094-9f05-89f380036864]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== disconnect_volume: return (407ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start _get_guest_xml network_info=[{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd64a477e-66b2-48b9-886d-ca146148167a', 'attached_at': '', 'detached_at': '', 'volume_id': '1973bafa-4051-412d-8fa0-ddbde478b590', 'serial': '1973bafa-4051-412d-8fa0-ddbde478b590'}, 'attachment_id': '14cbb8a0-8d92-4671-adf3-d19c4d8edf8f', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'numa_topology' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:06 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:06 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'vcpu_model' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:07:06 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:07:06 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:07:06 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6fa90-a87d-44d4-9f3a-c874b4bbd339]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:07:06 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[de684349-a55c-4046-8161-50ba3069f6ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590] added
Nov 09 01:07:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ea6bc1-d083-40e6-8701-5a7a28271b74]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee4907a-57fd-44ad-bdb8-7a8a043d5d00]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWiDgRSJ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWiDgRSJ" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ffb01e-ff15-467b-b28a-51a7daf87f0f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWiDgRSJ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4716e76-01c8-464f-ac63-e0c131d0b2ed]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf4a56-bd57-4753-813e-68ec4d705cea]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:07:07 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:07:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:07:07 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:07:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c47ea-cb08-48a5-822f-55b353ff586e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]
Nov 09 01:07:07 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.
Nov 09 01:07:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e5da8-8e52-4515-a3f9-8f42e8e658d3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19137e5-9726-4602-a96b-c221479db76d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:07:07 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:07:07 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:07:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:07:07 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:07:07 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:07:07 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[60896642-e154-4224-9424-6e06cf8f17d4]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:07:07 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '26236383664373532', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236383664373532', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'pci_devices' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:07:08 user nova-compute[74441]:   <uuid>d64a477e-66b2-48b9-886d-ca146148167a</uuid>
Nov 09 01:07:08 user nova-compute[74441]:   <name>instance-00000025</name>
Nov 09 01:07:08 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:07:08 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:07:08 user nova-compute[74441]:   <metadata>
Nov 09 01:07:08 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:07:08 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:07:08 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1798271286</nova:name>
Nov 09 01:07:08 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:07:06</nova:creationTime>
Nov 09 01:07:08 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:07:08 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:07:08 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:07:08 user nova-compute[74441]:       <nova:owner>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:user uuid="9d6713a112a64d03a7cd67c304a85ddd">tempest-AttachVolumeTestJSON-1454008029-project-member</nova:user>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:project uuid="01aa9979e78d4597ae023610b56f5a60">tempest-AttachVolumeTestJSON-1454008029</nova:project>
Nov 09 01:07:08 user nova-compute[74441]:       </nova:owner>
Nov 09 01:07:08 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:07:08 user nova-compute[74441]:       <nova:ports>
Nov 09 01:07:08 user nova-compute[74441]:         <nova:port uuid="65db9fd8-e6f2-41f5-9bcc-e52d93471f61">
Nov 09 01:07:08 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 01:07:08 user nova-compute[74441]:         </nova:port>
Nov 09 01:07:08 user nova-compute[74441]:       </nova:ports>
Nov 09 01:07:08 user nova-compute[74441]:     </nova:instance>
Nov 09 01:07:08 user nova-compute[74441]:   </metadata>
Nov 09 01:07:08 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:07:08 user nova-compute[74441]:     <system>
Nov 09 01:07:08 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:07:08 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:07:08 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:07:08 user nova-compute[74441]:       <entry name="serial">d64a477e-66b2-48b9-886d-ca146148167a</entry>
Nov 09 01:07:08 user nova-compute[74441]:       <entry name="uuid">d64a477e-66b2-48b9-886d-ca146148167a</entry>
Nov 09 01:07:08 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:07:08 user nova-compute[74441]:     </system>
Nov 09 01:07:08 user nova-compute[74441]:   </sysinfo>
Nov 09 01:07:08 user nova-compute[74441]:   <os>
Nov 09 01:07:08 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:07:08 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:07:08 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:07:08 user nova-compute[74441]:   </os>
Nov 09 01:07:08 user nova-compute[74441]:   <features>
Nov 09 01:07:08 user nova-compute[74441]:     <acpi/>
Nov 09 01:07:08 user nova-compute[74441]:     <apic/>
Nov 09 01:07:08 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:07:08 user nova-compute[74441]:   </features>
Nov 09 01:07:08 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:07:08 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:07:08 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:07:08 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:07:08 user nova-compute[74441]:   </clock>
Nov 09 01:07:08 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:07:08 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:07:08 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:07:08 user nova-compute[74441]:   </cpu>
Nov 09 01:07:08 user nova-compute[74441]:   <devices>
Nov 09 01:07:08 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:07:08 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:07:08 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk"/>
Nov 09 01:07:08 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:07:08 user nova-compute[74441]:     </disk>
Nov 09 01:07:08 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:07:08 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:07:08 user nova-compute[74441]:       <source dev="/dev/sdd"/>
Nov 09 01:07:08 user nova-compute[74441]:       <target dev="vdb" bus="virtio"/>
Nov 09 01:07:08 user nova-compute[74441]:       <serial>1973bafa-4051-412d-8fa0-ddbde478b590</serial>
Nov 09 01:07:08 user nova-compute[74441]:     </disk>
Nov 09 01:07:08 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:07:08 user nova-compute[74441]:       <mac address="fa:16:3e:d7:35:97"/>
Nov 09 01:07:08 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:07:08 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:07:08 user nova-compute[74441]:       <target dev="tap65db9fd8-e6"/>
Nov 09 01:07:08 user nova-compute[74441]:     </interface>
Nov 09 01:07:08 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:07:08 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/console.log" append="off"/>
Nov 09 01:07:08 user nova-compute[74441]:     </serial>
Nov 09 01:07:08 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:07:08 user nova-compute[74441]:     <video>
Nov 09 01:07:08 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:07:08 user nova-compute[74441]:     </video>
Nov 09 01:07:08 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:07:08 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:07:08 user nova-compute[74441]:     </rng>
Nov 09 01:07:08 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:07:08 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:07:08 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:07:08 user nova-compute[74441]:     </memballoon>
Nov 09 01:07:08 user nova-compute[74441]:   </devices>
Nov 09 01:07:08 user nova-compute[74441]: </domain>
Nov 09 01:07:08 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'trusted_certs' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.277s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Cannot resize image /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'migration_context' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.objects.base [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:05:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG os_vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e96a1d2f-03c5-57a5-b7ae-a530132e93c8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65db9fd8-e6, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65db9fd8-e6, col_values=(('qos', UUID('d83fda27-ec2d-4ab2-aca6-fe6ac75d6e95')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65db9fd8-e6, col_values=(('external_ids', {'iface-id': '65db9fd8-e6f2-41f5-9bcc-e52d93471f61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:35:97', 'vm-uuid': 'd64a477e-66b2-48b9-886d-ca146148167a'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:09 user nova-compute[74441]: INFO os_vif [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6')
Nov 09 01:07:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-3fa751f0-3c55-414b-a45e-d71c556a4c6d req-90269a31-6eef-4710-8e47-570a05deabe9 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3fa751f0-3c55-414b-a45e-d71c556a4c6d req-90269a31-6eef-4710-8e47-570a05deabe9 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3fa751f0-3c55-414b-a45e-d71c556a4c6d req-90269a31-6eef-4710-8e47-570a05deabe9 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3fa751f0-3c55-414b-a45e-d71c556a4c6d req-90269a31-6eef-4710-8e47-570a05deabe9 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-3fa751f0-3c55-414b-a45e-d71c556a4c6d req-90269a31-6eef-4710-8e47-570a05deabe9 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:11 user nova-compute[74441]: WARNING nova.compute.manager [req-3fa751f0-3c55-414b-a45e-d71c556a4c6d req-90269a31-6eef-4710-8e47-570a05deabe9 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state stopped and task_state powering-on.
Nov 09 01:07:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:07:13 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance rebooted successfully.
Nov 09 01:07:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a7fd2f88-666f-4236-b601-90dfe92a7e81 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-82e49bc6-e328-4f32-ad56-ccb5b930b6ea req-ab0efb65-6021-432c-a0dd-e08c0ad38086 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-82e49bc6-e328-4f32-ad56-ccb5b930b6ea req-ab0efb65-6021-432c-a0dd-e08c0ad38086 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-82e49bc6-e328-4f32-ad56-ccb5b930b6ea req-ab0efb65-6021-432c-a0dd-e08c0ad38086 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-82e49bc6-e328-4f32-ad56-ccb5b930b6ea req-ab0efb65-6021-432c-a0dd-e08c0ad38086 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-82e49bc6-e328-4f32-ad56-ccb5b930b6ea req-ab0efb65-6021-432c-a0dd-e08c0ad38086 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:13 user nova-compute[74441]: WARNING nova.compute.manager [req-82e49bc6-e328-4f32-ad56-ccb5b930b6ea req-ab0efb65-6021-432c-a0dd-e08c0ad38086 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state stopped and task_state powering-on.
Nov 09 01:07:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:07:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:18 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:18 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8058MB free_disk=24.93860626220703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 19f2dd9e-c2f4-4117-a53d-109679326aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d7483b9f-709b-4409-88bf-1adc3d51ac90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:07:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:07:19 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:07:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:07:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:07:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:07:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:07:33 user nova-compute[74441]: INFO nova.compute.claims [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Claim successful on node user
Nov 09 01:07:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:07:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.policy [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83a5376e1ace48398aff4b12cffed73f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce624f85b2844a38fbedfb9ab9c0636', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:07:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Creating image(s)
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "/opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "/opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "/opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk 1073741824" returned: 0 in 0.051s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Successfully created port: 08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Cannot resize image /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Ensure instance console log exists: /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Successfully updated port: 08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "refresh_cache-92f82896-9fe8-411a-a4c5-63807c70de1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquired lock "refresh_cache-92f82896-9fe8-411a-a4c5-63807c70de1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-changed-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.compute.manager [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Refreshing instance network info cache due to event network-changed-08cdfd1e-6e12-48db-98b1-f88d1922071b. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] Acquiring lock "refresh_cache-92f82896-9fe8-411a-a4c5-63807c70de1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Updating instance_info_cache with network_info: [{"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Releasing lock "refresh_cache-92f82896-9fe8-411a-a4c5-63807c70de1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Instance network_info: |[{"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] Acquired lock "refresh_cache-92f82896-9fe8-411a-a4c5-63807c70de1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Refreshing network info cache for port 08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Start _get_guest_xml network_info=[{"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:07:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:35 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1338467150',display_name='tempest-VolumesActionsTest-instance-1338467150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1338467150',id=41,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dce624f85b2844a38fbedfb9ab9c0636',ramdisk_id='',reservation_id='r-xt1w10a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-393272121',owner_user_name='tempest-VolumesActionsTest-393272121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:07:34Z,user_data=None,user_id='83a5376e1ace48398aff4b12cffed73f',uuid=92f82896-9fe8-411a-a4c5-63807c70de1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Converting VIF {"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lazy-loading 'pci_devices' on Instance uuid 92f82896-9fe8-411a-a4c5-63807c70de1e {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:07:35 user nova-compute[74441]:   <uuid>92f82896-9fe8-411a-a4c5-63807c70de1e</uuid>
Nov 09 01:07:35 user nova-compute[74441]:   <name>instance-00000029</name>
Nov 09 01:07:35 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:07:35 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:07:35 user nova-compute[74441]:   <metadata>
Nov 09 01:07:35 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:07:35 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:07:35 user nova-compute[74441]:       <nova:name>tempest-VolumesActionsTest-instance-1338467150</nova:name>
Nov 09 01:07:35 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:07:35</nova:creationTime>
Nov 09 01:07:35 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:07:35 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:07:35 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:07:35 user nova-compute[74441]:       <nova:owner>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:user uuid="83a5376e1ace48398aff4b12cffed73f">tempest-VolumesActionsTest-393272121-project-member</nova:user>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:project uuid="dce624f85b2844a38fbedfb9ab9c0636">tempest-VolumesActionsTest-393272121</nova:project>
Nov 09 01:07:35 user nova-compute[74441]:       </nova:owner>
Nov 09 01:07:35 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:07:35 user nova-compute[74441]:       <nova:ports>
Nov 09 01:07:35 user nova-compute[74441]:         <nova:port uuid="08cdfd1e-6e12-48db-98b1-f88d1922071b">
Nov 09 01:07:35 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 01:07:35 user nova-compute[74441]:         </nova:port>
Nov 09 01:07:35 user nova-compute[74441]:       </nova:ports>
Nov 09 01:07:35 user nova-compute[74441]:     </nova:instance>
Nov 09 01:07:35 user nova-compute[74441]:   </metadata>
Nov 09 01:07:35 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:07:35 user nova-compute[74441]:     <system>
Nov 09 01:07:35 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:07:35 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:07:35 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:07:35 user nova-compute[74441]:       <entry name="serial">92f82896-9fe8-411a-a4c5-63807c70de1e</entry>
Nov 09 01:07:35 user nova-compute[74441]:       <entry name="uuid">92f82896-9fe8-411a-a4c5-63807c70de1e</entry>
Nov 09 01:07:35 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:07:35 user nova-compute[74441]:     </system>
Nov 09 01:07:35 user nova-compute[74441]:   </sysinfo>
Nov 09 01:07:35 user nova-compute[74441]:   <os>
Nov 09 01:07:35 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:07:35 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:07:35 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:07:35 user nova-compute[74441]:   </os>
Nov 09 01:07:35 user nova-compute[74441]:   <features>
Nov 09 01:07:35 user nova-compute[74441]:     <acpi/>
Nov 09 01:07:35 user nova-compute[74441]:     <apic/>
Nov 09 01:07:35 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:07:35 user nova-compute[74441]:   </features>
Nov 09 01:07:35 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:07:35 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:07:35 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:07:35 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:07:35 user nova-compute[74441]:   </clock>
Nov 09 01:07:35 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:07:35 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:07:35 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:07:35 user nova-compute[74441]:   </cpu>
Nov 09 01:07:35 user nova-compute[74441]:   <devices>
Nov 09 01:07:35 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:07:35 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:07:35 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk"/>
Nov 09 01:07:35 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:07:35 user nova-compute[74441]:     </disk>
Nov 09 01:07:35 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:07:35 user nova-compute[74441]:       <mac address="fa:16:3e:e9:76:57"/>
Nov 09 01:07:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:07:35 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:07:35 user nova-compute[74441]:       <target dev="tap08cdfd1e-6e"/>
Nov 09 01:07:35 user nova-compute[74441]:     </interface>
Nov 09 01:07:35 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:07:35 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/console.log" append="off"/>
Nov 09 01:07:35 user nova-compute[74441]:     </serial>
Nov 09 01:07:35 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:07:35 user nova-compute[74441]:     <video>
Nov 09 01:07:35 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:07:35 user nova-compute[74441]:     </video>
Nov 09 01:07:35 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:07:35 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:07:35 user nova-compute[74441]:     </rng>
Nov 09 01:07:35 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:07:35 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:07:35 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:07:35 user nova-compute[74441]:     </memballoon>
Nov 09 01:07:35 user nova-compute[74441]:   </devices>
Nov 09 01:07:35 user nova-compute[74441]: </domain>
Nov 09 01:07:35 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1338467150',display_name='tempest-VolumesActionsTest-instance-1338467150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1338467150',id=41,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dce624f85b2844a38fbedfb9ab9c0636',ramdisk_id='',reservation_id='r-xt1w10a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-393272121',owner_user_name='tempest-VolumesActionsTest-393272121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:07:34Z,user_data=None,user_id='83a5376e1ace48398aff4b12cffed73f',uuid=92f82896-9fe8-411a-a4c5-63807c70de1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Converting VIF {"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG os_vif [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '299d3785-28c1-558b-a4f3-ed4762ecfa23', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08cdfd1e-6e, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08cdfd1e-6e, col_values=(('qos', UUID('0eaa09a5-ea80-460d-b2b6-70174d0e78be')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08cdfd1e-6e, col_values=(('external_ids', {'iface-id': '08cdfd1e-6e12-48db-98b1-f88d1922071b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:76:57', 'vm-uuid': '92f82896-9fe8-411a-a4c5-63807c70de1e'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:35 user nova-compute[74441]: INFO os_vif [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e')
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] No VIF found with MAC fa:16:3e:e9:76:57, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Updated VIF entry in instance network info cache for port 08cdfd1e-6e12-48db-98b1-f88d1922071b. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG nova.network.neutron [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Updating instance_info_cache with network_info: [{"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-487545c4-103a-4dbd-bab7-94b479315757 req-45cb464c-4eb2-4012-872a-ab6256b5acdd service nova] Releasing lock "refresh_cache-92f82896-9fe8-411a-a4c5-63807c70de1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:07:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-14b5ec2e-8870-42a5-9454-43734d252a76 req-d2c67ab7-6478-4f82-89f5-5f080acb3a6f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-14b5ec2e-8870-42a5-9454-43734d252a76 req-d2c67ab7-6478-4f82-89f5-5f080acb3a6f service nova] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-14b5ec2e-8870-42a5-9454-43734d252a76 req-d2c67ab7-6478-4f82-89f5-5f080acb3a6f service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-14b5ec2e-8870-42a5-9454-43734d252a76 req-d2c67ab7-6478-4f82-89f5-5f080acb3a6f service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-14b5ec2e-8870-42a5-9454-43734d252a76 req-d2c67ab7-6478-4f82-89f5-5f080acb3a6f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] No waiting events found dispatching network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:37 user nova-compute[74441]: WARNING nova.compute.manager [req-14b5ec2e-8870-42a5-9454-43734d252a76 req-d2c67ab7-6478-4f82-89f5-5f080acb3a6f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received unexpected event network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b for instance with vm_state building and task_state spawning.
Nov 09 01:07:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:07:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Instance spawned successfully.
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-e5aac3ed-4260-4d26-9775-956d879f2f53 req-688eab7d-5ead-4d25-b17c-fabf8069d2c1 service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e5aac3ed-4260-4d26-9775-956d879f2f53 req-688eab7d-5ead-4d25-b17c-fabf8069d2c1 service nova] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e5aac3ed-4260-4d26-9775-956d879f2f53 req-688eab7d-5ead-4d25-b17c-fabf8069d2c1 service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e5aac3ed-4260-4d26-9775-956d879f2f53 req-688eab7d-5ead-4d25-b17c-fabf8069d2c1 service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-e5aac3ed-4260-4d26-9775-956d879f2f53 req-688eab7d-5ead-4d25-b17c-fabf8069d2c1 service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] No waiting events found dispatching network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:39 user nova-compute[74441]: WARNING nova.compute.manager [req-e5aac3ed-4260-4d26-9775-956d879f2f53 req-688eab7d-5ead-4d25-b17c-fabf8069d2c1 service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received unexpected event network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b for instance with vm_state building and task_state spawning.
Nov 09 01:07:39 user nova-compute[74441]: INFO nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 09 01:07:39 user nova-compute[74441]: DEBUG nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:07:39 user nova-compute[74441]: INFO nova.compute.manager [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Took 6.18 seconds to build instance.
Nov 09 01:07:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f7d1a17c-df53-43d2-b026-28b5898ae32a tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.275s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:54 user nova-compute[74441]: INFO nova.compute.manager [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Terminating instance
Nov 09 01:07:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Instance destroyed successfully.
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lazy-loading 'resources' on Instance uuid c9a2a32a-0b08-4a4b-bfd1-c6c88983d312 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-29b9998a-fcc8-4575-89e4-d2da5c8a25f6 req-a9f80779-c660-44b7-8fa9-aeb2f84c486c service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-vif-unplugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29b9998a-fcc8-4575-89e4-d2da5c8a25f6 req-a9f80779-c660-44b7-8fa9-aeb2f84c486c service nova] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29b9998a-fcc8-4575-89e4-d2da5c8a25f6 req-a9f80779-c660-44b7-8fa9-aeb2f84c486c service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29b9998a-fcc8-4575-89e4-d2da5c8a25f6 req-a9f80779-c660-44b7-8fa9-aeb2f84c486c service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-29b9998a-fcc8-4575-89e4-d2da5c8a25f6 req-a9f80779-c660-44b7-8fa9-aeb2f84c486c service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] No waiting events found dispatching network-vif-unplugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-29b9998a-fcc8-4575-89e4-d2da5c8a25f6 req-a9f80779-c660-44b7-8fa9-aeb2f84c486c service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-vif-unplugged-fbce1843-c995-458c-a094-e46838e22a25 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-400101954',display_name='tempest-SnapshotDataIntegrityTests-server-400101954',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-400101954',id=29,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPy+fRBkVlFgLj2C9BtyO3SUIIb9ReccyoNztfolIfbm10XoAtrfLjMQJ4l8z6Z/HJlzhRPipFFBaPNBa36+13gQqbeIsQhxwsdtNBG4N4EGKxZQesLj6nk1LKPKB2vmw==',key_name='tempest-keypair-2012682569',keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:57:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='967adbed91e24d0d86706b6884beaacd',ramdisk_id='',reservation_id='r-w5ohmn04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-874532405',owner_user_name='tempest-SnapshotDataIntegrityTests-874532405-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:57:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dff88b5dff14f34a7c222f369ee6848',uuid=c9a2a32a-0b08-4a4b-bfd1-c6c88983d312,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Converting VIF {"id": "fbce1843-c995-458c-a094-e46838e22a25", "address": "fa:16:3e:45:27:b1", "network": {"id": "6a2bbcf0-5146-4125-a458-ffaa05584e11", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1204103226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "967adbed91e24d0d86706b6884beaacd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbce1843-c9", "ovs_interfaceid": "fbce1843-c995-458c-a094-e46838e22a25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG os_vif [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbce1843-c9, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a755461b-9072-4c22-88fb-c0c8de6ec908) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:07:55 user nova-compute[74441]: INFO os_vif [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:27:b1,bridge_name='br-int',has_traffic_filtering=True,id=fbce1843-c995-458c-a094-e46838e22a25,network=Network(6a2bbcf0-5146-4125-a458-ffaa05584e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbce1843-c9')
Nov 09 01:07:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Deleting instance files /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312_del
Nov 09 01:07:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Deletion of /opt/stack/data/nova/instances/c9a2a32a-0b08-4a4b-bfd1-c6c88983d312_del complete
Nov 09 01:07:55 user nova-compute[74441]: INFO nova.compute.manager [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 09 01:07:55 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:07:55 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:07:56 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:07:56 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Took 1.29 seconds to deallocate network for instance.
Nov 09 01:07:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:57 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Deleted allocations for instance c9a2a32a-0b08-4a4b-bfd1-c6c88983d312
Nov 09 01:07:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f1d-9885-4947-afad-85e2d288cec9 tempest-SnapshotDataIntegrityTests-874532405 tempest-SnapshotDataIntegrityTests-874532405-project-member] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] Acquiring lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] Lock "c9a2a32a-0b08-4a4b-bfd1-c6c88983d312-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:07:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] No waiting events found dispatching network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:07:57 user nova-compute[74441]: WARNING nova.compute.manager [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received unexpected event network-vif-plugged-fbce1843-c995-458c-a094-e46838e22a25 for instance with vm_state deleted and task_state None.
Nov 09 01:07:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-88227518-e5de-4202-809c-91df0a199813 req-5538159c-125b-4341-bcf1-6017985dfabf service nova] [instance: c9a2a32a-0b08-4a4b-bfd1-c6c88983d312] Received event network-vif-deleted-fbce1843-c995-458c-a094-e46838e22a25 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:07:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-changed-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:07:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Refreshing instance network info cache due to event network-changed-9afac105-0e2a-412c-b715-a90e4ae4aa76. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:07:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] Acquiring lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:07:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] Acquired lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:07:59 user nova-compute[74441]: DEBUG nova.network.neutron [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Refreshing network info cache for port 9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:08:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updated VIF entry in instance network info cache for port 9afac105-0e2a-412c-b715-a90e4ae4aa76. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:08:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updating instance_info_cache with network_info: [{"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:08:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-afabed28-3ad2-43a3-ac5b-384673cd49bc req-d49d4c4d-a7fe-48c1-bb7b-37063e13db9c service nova] Releasing lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:08:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:08:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:08:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:08:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:08:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:17 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:08:17 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=24.871257781982422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 19f2dd9e-c2f4-4117-a53d-109679326aee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d7483b9f-709b-4409-88bf-1adc3d51ac90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 92f82896-9fe8-411a-a4c5-63807c70de1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 2c5247d7-a8ce-4443-b3c1-72445c6c06ce has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:08:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.155s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:08:18 user nova-compute[74441]: INFO nova.compute.claims [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Claim successful on node user
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.network.neutron [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:08:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.policy [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd80ab02de6b249c3adecf0597940ea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9194fd2e7248a2bdbfd3d57f846fed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:08:18 user nova-compute[74441]: INFO nova.virt.block_device [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Booting with volume a7335396-552d-425e-8045-897a4f0cabc1 at /dev/vda
Nov 09 01:08:18 user nova-compute[74441]: DEBUG os_brick.utils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[363662d1-2bb3-44e1-8aa7-2f4388938d3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[603aef71-a0cb-444e-8006-a47592d1ecb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ea9dd-cfae-4e0e-9939-3dba3a435a27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f80bf-1d06-4ee4-8dfe-9ab43bf8bc1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:08:18 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:08:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de75f16-ec9b-4e97-a713-54ccc077bc27]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG os_brick.utils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:08:18 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating existing volume attachment record: 2c3137ee-55e9-48f3-ae06-8c78955634ae {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:08:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Successfully created port: 6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:08:19 user nova-compute[74441]: DEBUG nova.network.neutron [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Successfully updated port: 6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquired lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-changed-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Refreshing instance network info cache due to event network-changed-6cbc638d-16c7-43b6-a4d9-3a68108fdd66. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] Acquiring lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.network.neutron [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating instance_info_cache with network_info: [{"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Releasing lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Instance network_info: |[{"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] Acquired lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Refreshing network info cache for port 6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updated VIF entry in instance network info cache for port 6cbc638d-16c7-43b6-a4d9-3a68108fdd66. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG nova.network.neutron [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating instance_info_cache with network_info: [{"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:08:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-638dcd7c-34ab-46d0-ae43-cc4b9e01e4c2 req-a726f307-c48a-41c1-9176-1754e668180f service nova] Releasing lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:08:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:08:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:08:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:08:43 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Creating image(s)
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Did not create local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Ensure instance console log exists: /opt/stack/data/nova/instances/2c5247d7-a8ce-4443-b3c1-72445c6c06ce/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Start _get_guest_xml network_info=[{"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'guest_format': None, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AravVIzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c5247d7-a8ce-4443-b3c1-72445c6c06ce', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7335396-552d-425e-8045-897a4f0cabc1', 'serial': 'a7335396-552d-425e-8045-897a4f0cabc1'}, 'attachment_id': '2c3137ee-55e9-48f3-ae06-8c78955634ae', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:08:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:08:43 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AravVIzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:08:43 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:08:43 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:08:43 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1516da80-1e37-456b-8dcc-6567137765a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:08:43 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb9739-67aa-4fe3-aa6e-9dabb3c2e254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1] added
Nov 09 01:08:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e074b32-d198-4254-a2f9-209479b9af35]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74de3213-a607-4eef-bf87-88a2a5f3cdb6]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AravVIzY {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AravVIzY" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34399d19-6520-48fa-a72a-4374023feb52]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AravVIzY'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbf5447-0a3b-44db-b979-71072eba9937]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e40a43-c4e8-4b2e-80be-cbcd42ccccc0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:08:43 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:08:43 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:08:43 user nova-compute[74441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)
Nov 09 01:08:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:08:43 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:08:43 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:08:43 user nova-compute[74441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)
Nov 09 01:08:43 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:08:43 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a46eca-41cd-4402-93ba-212017b213a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260]
Nov 09 01:08:44 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260] successful.
Nov 09 01:08:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[db561e20-3702-4dd8-a335-43e85a96583e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[36055c27-5b09-4e9a-b1bd-ed4b2c4c1465]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:08:44 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c60039-abc8-4784-b193-3261b75334df]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:44 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AravVIzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23864316436333165', 'path': '/dev/sdf'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864316436333165', 'path': '/dev/sdf'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1660626130',display_name='tempest-TestVolumeBootPattern-server-1660626130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1660626130',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-jgnjb6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:08:19Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=2c5247d7-a8ce-4443-b3c1-72445c6c06ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.objects.instance [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c5247d7-a8ce-4443-b3c1-72445c6c06ce {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:08:45 user nova-compute[74441]:   <uuid>2c5247d7-a8ce-4443-b3c1-72445c6c06ce</uuid>
Nov 09 01:08:45 user nova-compute[74441]:   <name>instance-0000002a</name>
Nov 09 01:08:45 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:08:45 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:08:45 user nova-compute[74441]:   <metadata>
Nov 09 01:08:45 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:08:45 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:08:45 user nova-compute[74441]:       <nova:name>tempest-TestVolumeBootPattern-server-1660626130</nova:name>
Nov 09 01:08:45 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:08:43</nova:creationTime>
Nov 09 01:08:45 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:08:45 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:08:45 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:08:45 user nova-compute[74441]:       <nova:owner>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:user uuid="d80ab02de6b249c3adecf0597940ea76">tempest-TestVolumeBootPattern-1724241999-project-member</nova:user>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:project uuid="ad9194fd2e7248a2bdbfd3d57f846fed">tempest-TestVolumeBootPattern-1724241999</nova:project>
Nov 09 01:08:45 user nova-compute[74441]:       </nova:owner>
Nov 09 01:08:45 user nova-compute[74441]:       <nova:ports>
Nov 09 01:08:45 user nova-compute[74441]:         <nova:port uuid="6cbc638d-16c7-43b6-a4d9-3a68108fdd66">
Nov 09 01:08:45 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 01:08:45 user nova-compute[74441]:         </nova:port>
Nov 09 01:08:45 user nova-compute[74441]:       </nova:ports>
Nov 09 01:08:45 user nova-compute[74441]:     </nova:instance>
Nov 09 01:08:45 user nova-compute[74441]:   </metadata>
Nov 09 01:08:45 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:08:45 user nova-compute[74441]:     <system>
Nov 09 01:08:45 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:08:45 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:08:45 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:08:45 user nova-compute[74441]:       <entry name="serial">2c5247d7-a8ce-4443-b3c1-72445c6c06ce</entry>
Nov 09 01:08:45 user nova-compute[74441]:       <entry name="uuid">2c5247d7-a8ce-4443-b3c1-72445c6c06ce</entry>
Nov 09 01:08:45 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:08:45 user nova-compute[74441]:     </system>
Nov 09 01:08:45 user nova-compute[74441]:   </sysinfo>
Nov 09 01:08:45 user nova-compute[74441]:   <os>
Nov 09 01:08:45 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:08:45 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:08:45 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:08:45 user nova-compute[74441]:   </os>
Nov 09 01:08:45 user nova-compute[74441]:   <features>
Nov 09 01:08:45 user nova-compute[74441]:     <acpi/>
Nov 09 01:08:45 user nova-compute[74441]:     <apic/>
Nov 09 01:08:45 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:08:45 user nova-compute[74441]:   </features>
Nov 09 01:08:45 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:08:45 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:08:45 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:08:45 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:08:45 user nova-compute[74441]:   </clock>
Nov 09 01:08:45 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:08:45 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:08:45 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:08:45 user nova-compute[74441]:   </cpu>
Nov 09 01:08:45 user nova-compute[74441]:   <devices>
Nov 09 01:08:45 user nova-compute[74441]:     <disk type="block" device="disk">
Nov 09 01:08:45 user nova-compute[74441]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:08:45 user nova-compute[74441]:       <source dev="/dev/sdf"/>
Nov 09 01:08:45 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:08:45 user nova-compute[74441]:       <serial>a7335396-552d-425e-8045-897a4f0cabc1</serial>
Nov 09 01:08:45 user nova-compute[74441]:     </disk>
Nov 09 01:08:45 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:08:45 user nova-compute[74441]:       <mac address="fa:16:3e:f4:91:65"/>
Nov 09 01:08:45 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:08:45 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:08:45 user nova-compute[74441]:       <target dev="tap6cbc638d-16"/>
Nov 09 01:08:45 user nova-compute[74441]:     </interface>
Nov 09 01:08:45 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:08:45 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/2c5247d7-a8ce-4443-b3c1-72445c6c06ce/console.log" append="off"/>
Nov 09 01:08:45 user nova-compute[74441]:     </serial>
Nov 09 01:08:45 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:08:45 user nova-compute[74441]:     <video>
Nov 09 01:08:45 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:08:45 user nova-compute[74441]:     </video>
Nov 09 01:08:45 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:08:45 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:08:45 user nova-compute[74441]:     </rng>
Nov 09 01:08:45 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:08:45 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:08:45 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:08:45 user nova-compute[74441]:     </memballoon>
Nov 09 01:08:45 user nova-compute[74441]:   </devices>
Nov 09 01:08:45 user nova-compute[74441]: </domain>
Nov 09 01:08:45 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1660626130',display_name='tempest-TestVolumeBootPattern-server-1660626130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1660626130',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-jgnjb6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:08:19Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=2c5247d7-a8ce-4443-b3c1-72445c6c06ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG os_vif [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '903cc2c1-05a6-5fe4-9e51-b9382188f1cd', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cbc638d-16, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cbc638d-16, col_values=(('qos', UUID('b5734a2d-5e5a-4099-9a79-2d13b5a19504')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cbc638d-16, col_values=(('external_ids', {'iface-id': '6cbc638d-16c7-43b6-a4d9-3a68108fdd66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:91:65', 'vm-uuid': '2c5247d7-a8ce-4443-b3c1-72445c6c06ce'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:08:45 user nova-compute[74441]: INFO os_vif [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16')
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] No VIF found with MAC fa:16:3e:f4:91:65, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-changed-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.compute.manager [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Refreshing instance network info cache due to event network-changed-25fe7b32-7327-4f43-b342-eeb0498a90b4. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] Acquiring lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] Acquired lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:08:45 user nova-compute[74441]: DEBUG nova.network.neutron [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Refreshing network info cache for port 25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updated VIF entry in instance network info cache for port 25fe7b32-7327-4f43-b342-eeb0498a90b4. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG nova.network.neutron [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updating instance_info_cache with network_info: [{"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5918fdf6-2a7b-4870-b5a5-d9494b5ed8b5 req-01f64358-ebb8-4846-82ef-74ec6601c283 service nova] Releasing lock "refresh_cache-63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] No waiting events found dispatching network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:08:48 user nova-compute[74441]: WARNING nova.compute.manager [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received unexpected event network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 for instance with vm_state building and task_state spawning.
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] No waiting events found dispatching network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:08:48 user nova-compute[74441]: WARNING nova.compute.manager [req-6cdbbc49-f694-431c-89f3-de98ac719050 req-d00d7a92-4eba-4bfb-9d2c-bad2f8e0db90 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received unexpected event network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 for instance with vm_state building and task_state spawning.
Nov 09 01:08:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:08:48 user nova-compute[74441]: INFO nova.compute.manager [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] instance snapshotting
Nov 09 01:08:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Beginning live snapshot process
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:08:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Instance spawned successfully.
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:08:48 user nova-compute[74441]: INFO nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 09 01:08:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:49 user nova-compute[74441]: INFO nova.compute.manager [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Took 31.24 seconds to build instance.
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-796ebbbe-8d64-42bf-b533-a232b530cbb6 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.338s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_e5ut714/a5317f98049149feade49fba0e79ccbb.delta 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:49 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_e5ut714/a5317f98049149feade49fba0e79ccbb.delta 1073741824" returned: 0 in 0.062s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:49 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 01:08:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] COPY block job progress, current cursor: 786432 final cursor: 75497472 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 01:08:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 01:08:50 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 01:08:51 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 01:08:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_e5ut714/a5317f98049149feade49fba0e79ccbb.delta /opt/stack/data/nova/instances/snapshots/tmp_e5ut714/a5317f98049149feade49fba0e79ccbb {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_e5ut714/a5317f98049149feade49fba0e79ccbb.delta /opt/stack/data/nova/instances/snapshots/tmp_e5ut714/a5317f98049149feade49fba0e79ccbb" returned: 0 in 0.606s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Snapshot extracted, beginning image upload
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:53 user nova-compute[74441]: INFO nova.compute.manager [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Attaching volume 997051d3-fab8-4ab6-8e58-cf2b91146a79 to /dev/vdb
Nov 09 01:08:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89a1f5-7419-4f50-80a4-a6215e9b3660]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9acd642-64ba-4671-af74-bbaca401ecbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7899ffee-0723-4974-9950-a637af6a206d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af0eb1d-147c-4e68-baea-1f5bbb07a5c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:08:53 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:08:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3c9257-11e3-4c28-baa8-2f6b810b81aa]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG os_brick.utils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:08:53 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updating existing volume attachment record: 21d0f764-01d6-43c7-974f-9f91a3ed1dee {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:08:54 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Snapshot image upload complete
Nov 09 01:08:54 user nova-compute[74441]: INFO nova.compute.manager [None req-de6ee30f-8726-4f75-8691-d66a50841317 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Took 6.07 seconds to snapshot the instance on the hypervisor.
Nov 09 01:08:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:08:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:08:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:08:57 user nova-compute[74441]: INFO nova.compute.manager [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Detaching volume 1973bafa-4051-412d-8fa0-ddbde478b590
Nov 09 01:08:57 user nova-compute[74441]: INFO nova.virt.block_device [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Attempting to driver detach volume 1973bafa-4051-412d-8fa0-ddbde478b590 from mountpoint /dev/vdb
Nov 09 01:08:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Attempting to detach device vdb from instance d64a477e-66b2-48b9-886d-ca146148167a from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:08:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:08:57 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:08:57 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:08:57 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:08:57 user nova-compute[74441]:   <serial>1973bafa-4051-412d-8fa0-ddbde478b590</serial>
Nov 09 01:08:57 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 01:08:57 user nova-compute[74441]: </disk>
Nov 09 01:08:57 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:08:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully detached device vdb from instance d64a477e-66b2-48b9-886d-ca146148167a from the persistent domain config.
Nov 09 01:08:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d64a477e-66b2-48b9-886d-ca146148167a from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:08:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:08:57 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:08:57 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:08:57 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:08:57 user nova-compute[74441]:   <serial>1973bafa-4051-412d-8fa0-ddbde478b590</serial>
Nov 09 01:08:57 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 01:08:57 user nova-compute[74441]: </disk>
Nov 09 01:08:57 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:08:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:08:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updating instance_info_cache with network_info: [{"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:09:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:09:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:09:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:14 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d64a477e-66b2-48b9-886d-ca146148167a is timed out.
Nov 09 01:09:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully detached device vdb from instance d64a477e-66b2-48b9-886d-ca146148167a from the live domain config.
Nov 09 01:09:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWiDgRSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:09:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f150e95c-36e3-43b4-b3b2-3f9ee5ddc718]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:09:17 user nova-compute[74441]: No targets found.
Nov 09 01:09:17 user nova-compute[74441]: iSNS:
Nov 09 01:09:17 user nova-compute[74441]: No targets found.
Nov 09 01:09:17 user nova-compute[74441]: STATIC:
Nov 09 01:09:17 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:09:17 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:17 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:17 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1
Nov 09 01:09:17 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:17 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:17 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590
Nov 09 01:09:17 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:17 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:17 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1
Nov 09 01:09:17 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:17 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:17 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:09:17 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:17 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:17 user nova-compute[74441]: FIRMWARE:
Nov 09 01:09:17 user nova-compute[74441]: No targets found.
Nov 09 01:09:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:09:17 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:09:17 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc15fb8-b6a8-4001-aaff-95928e2c9ede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d33ae59-2fdc-4bd1-bee7-dfd795021d3b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a80eddb-7189-4777-b3e7-8dc291e042e1 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:17 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c4f2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:09:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bb121e-3679-4f46-8059-b3b299ac487c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ee924f-8338-4b67-8074-a530fcfd0870]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c92254-0b53-4f9e-a37a-c56e795c9f02]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f5c0d-d308-4c4b-b17b-1314cc5a95e2]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4904e3af-7e26-4131-9fa4-d763163bacc8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddb7cc3-a461-4b16-99d1-87b875179dc2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260]
Nov 09 01:09:18 user nova-compute[74441]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590, portal: 172.16.0.220,3260] successful.
Nov 09 01:09:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1973bafa-4051-412d-8fa0-ddbde478b590 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ba31d-cab5-440d-a56d-9d68b1c4365e]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== disconnect_volume: return (404ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-56341755-a9d8-4c6f-ae3e-197b8be5393b tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.298s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:09:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=24.810253143310547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74441) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 19f2dd9e-c2f4-4117-a53d-109679326aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d7483b9f-709b-4409-88bf-1adc3d51ac90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 92f82896-9fe8-411a-a4c5-63807c70de1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 2c5247d7-a8ce-4443-b3c1-72445c6c06ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-87faaabf-784d-41ab-841f-0dcce95a829c req-1cb5faff-bb2e-47e0-9c12-29ae5466201f service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-87faaabf-784d-41ab-841f-0dcce95a829c req-1cb5faff-bb2e-47e0-9c12-29ae5466201f service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-87faaabf-784d-41ab-841f-0dcce95a829c req-1cb5faff-bb2e-47e0-9c12-29ae5466201f service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-87faaabf-784d-41ab-841f-0dcce95a829c req-1cb5faff-bb2e-47e0-9c12-29ae5466201f service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-87faaabf-784d-41ab-841f-0dcce95a829c req-1cb5faff-bb2e-47e0-9c12-29ae5466201f service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:09:20 user nova-compute[74441]: WARNING nova.compute.manager [req-87faaabf-784d-41ab-841f-0dcce95a829c req-1cb5faff-bb2e-47e0-9c12-29ae5466201f service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state active and task_state powering-off.
Nov 09 01:09:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 01:09:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance destroyed successfully.
Nov 09 01:09:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:09:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-99956128-80d6-4f71-8a2f-0c2e026a0245 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.908s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-34e51dd0-da16-45c1-887c-3aa582466f99 req-26ecee5f-5c6b-4460-beb0-04892caff95b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-34e51dd0-da16-45c1-887c-3aa582466f99 req-26ecee5f-5c6b-4460-beb0-04892caff95b service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-34e51dd0-da16-45c1-887c-3aa582466f99 req-26ecee5f-5c6b-4460-beb0-04892caff95b service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-34e51dd0-da16-45c1-887c-3aa582466f99 req-26ecee5f-5c6b-4460-beb0-04892caff95b service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:22 user nova-compute[74441]: DEBUG nova.compute.manager [req-34e51dd0-da16-45c1-887c-3aa582466f99 req-26ecee5f-5c6b-4460-beb0-04892caff95b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:09:22 user nova-compute[74441]: WARNING nova.compute.manager [req-34e51dd0-da16-45c1-887c-3aa582466f99 req-26ecee5f-5c6b-4460-beb0-04892caff95b service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state stopped and task_state None.
Nov 09 01:09:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKSYhLiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:09:30 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:09:30 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:09:30 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af9c70-56bd-4fc3-b7c1-7165604dc7d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:09:30 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa0038-f837-46ce-836a-fec8f13bb4ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79] added
Nov 09 01:09:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a6e367-1508-4e9a-8fc3-5712adf3db5d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8508a1a7-c07b-4ac1-899d-f9f4a0dd649c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKSYhLiV {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKSYhLiV" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c788085a-c5f7-427f-b12c-6a10ba5009af]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DKSYhLiV'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8085e8-2f15-4abb-8208-872c4343ccee]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3497970-07cc-4d4a-ac59-8ccc42e7ec1d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac3fa3-2475-4cee-bff2-f05e1882b7fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260]
Nov 09 01:09:30 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260] successful.
Nov 09 01:09:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdefbc9f-a176-4f09-8173-69fb463e1805]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e07e52-bf55-4210-b346-9cdb558fc3ee]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 (non-flash)
Nov 09 01:09:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[769c5544-fe6b-48e2-b077-630347c0bd16]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:09:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKSYhLiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:09:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:09:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26234633938333032', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:09:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234633938333032', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:09:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:09:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:09:31 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:09:31 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:09:31 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:09:31 user nova-compute[74441]:   <serial>997051d3-fab8-4ab6-8e58-cf2b91146a79</serial>
Nov 09 01:09:31 user nova-compute[74441]: </disk>
Nov 09 01:09:31 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:09:32 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:09:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:09:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:09:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] No VIF found with MAC fa:16:3e:55:92:6e, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:09:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a1976fdb-cfcb-4909-a209-c7e18d7ad174 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:33 user nova-compute[74441]: INFO nova.compute.manager [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Detaching volume 997051d3-fab8-4ab6-8e58-cf2b91146a79
Nov 09 01:09:33 user nova-compute[74441]: INFO nova.virt.block_device [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Attempting to driver detach volume 997051d3-fab8-4ab6-8e58-cf2b91146a79 from mountpoint /dev/vdb
Nov 09 01:09:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Attempting to detach device vdb from instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:09:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:09:33 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:09:33 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:09:33 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:09:33 user nova-compute[74441]:   <serial>997051d3-fab8-4ab6-8e58-cf2b91146a79</serial>
Nov 09 01:09:33 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:09:33 user nova-compute[74441]: </disk>
Nov 09 01:09:33 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:09:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully detached device vdb from instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 from the persistent domain config.
Nov 09 01:09:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:09:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:09:33 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:09:33 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:09:33 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:09:33 user nova-compute[74441]:   <serial>997051d3-fab8-4ab6-8e58-cf2b91146a79</serial>
Nov 09 01:09:33 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:09:33 user nova-compute[74441]: </disk>
Nov 09 01:09:33 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:09:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:09:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:09:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:50 user nova-compute[74441]: INFO nova.compute.manager [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Terminating instance
Nov 09 01:09:50 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-c09c7df4-bced-4955-b925-302a85bd0be1 req-5fa6788c-e531-4238-b613-81152b2e7d4b service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-vif-unplugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c09c7df4-bced-4955-b925-302a85bd0be1 req-5fa6788c-e531-4238-b613-81152b2e7d4b service nova] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c09c7df4-bced-4955-b925-302a85bd0be1 req-5fa6788c-e531-4238-b613-81152b2e7d4b service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c09c7df4-bced-4955-b925-302a85bd0be1 req-5fa6788c-e531-4238-b613-81152b2e7d4b service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-c09c7df4-bced-4955-b925-302a85bd0be1 req-5fa6788c-e531-4238-b613-81152b2e7d4b service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] No waiting events found dispatching network-vif-unplugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:09:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-c09c7df4-bced-4955-b925-302a85bd0be1 req-5fa6788c-e531-4238-b613-81152b2e7d4b service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-vif-unplugged-08cdfd1e-6e12-48db-98b1-f88d1922071b for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Instance destroyed successfully.
Nov 09 01:09:51 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lazy-loading 'resources' on Instance uuid 92f82896-9fe8-411a-a4c5-63807c70de1e {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1338467150',display_name='tempest-VolumesActionsTest-instance-1338467150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1338467150',id=41,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:07:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dce624f85b2844a38fbedfb9ab9c0636',ramdisk_id='',reservation_id='r-xt1w10a3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-393272121',owner_user_name='tempest-VolumesActionsTest-393272121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:07:39Z,user_data=None,user_id='83a5376e1ace48398aff4b12cffed73f',uuid=92f82896-9fe8-411a-a4c5-63807c70de1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Converting VIF {"id": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "address": "fa:16:3e:e9:76:57", "network": {"id": "4ec81b16-d06c-44a3-abf3-3be3f6b2daa2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1983704622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce624f85b2844a38fbedfb9ab9c0636", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08cdfd1e-6e", "ovs_interfaceid": "08cdfd1e-6e12-48db-98b1-f88d1922071b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG os_vif [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08cdfd1e-6e, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0eaa09a5-ea80-460d-b2b6-70174d0e78be) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: INFO os_vif [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:76:57,bridge_name='br-int',has_traffic_filtering=True,id=08cdfd1e-6e12-48db-98b1-f88d1922071b,network=Network(4ec81b16-d06c-44a3-abf3-3be3f6b2daa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08cdfd1e-6e')
Nov 09 01:09:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Deleting instance files /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e_del
Nov 09 01:09:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Deletion of /opt/stack/data/nova/instances/92f82896-9fe8-411a-a4c5-63807c70de1e_del complete
Nov 09 01:09:51 user nova-compute[74441]: INFO nova.compute.manager [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 09 01:09:51 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:09:52 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Took 0.63 seconds to deallocate network for instance.
Nov 09 01:09:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:09:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:52 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Deleted allocations for instance 92f82896-9fe8-411a-a4c5-63807c70de1e
Nov 09 01:09:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c3e5a6fc-15b6-4a9c-8177-9fb7c4efc12e tempest-VolumesActionsTest-393272121 tempest-VolumesActionsTest-393272121-project-member] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] Acquiring lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] Lock "92f82896-9fe8-411a-a4c5-63807c70de1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] No waiting events found dispatching network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:09:53 user nova-compute[74441]: WARNING nova.compute.manager [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received unexpected event network-vif-plugged-08cdfd1e-6e12-48db-98b1-f88d1922071b for instance with vm_state deleted and task_state None.
Nov 09 01:09:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-e512f2f1-e827-44e7-921a-e190b6e12683 req-2695534f-1c95-4e5b-9ed6-40da3d0f634f service nova] [instance: 92f82896-9fe8-411a-a4c5-63807c70de1e] Received event network-vif-deleted-08cdfd1e-6e12-48db-98b1-f88d1922071b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:09:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 is timed out.
Nov 09 01:09:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully detached device vdb from instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 from the live domain config.
Nov 09 01:09:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKSYhLiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:09:53 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a305e85e-8203-4e79-8bfd-46c85c0ea38b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:09:53 user nova-compute[74441]: No targets found.
Nov 09 01:09:53 user nova-compute[74441]: iSNS:
Nov 09 01:09:53 user nova-compute[74441]: No targets found.
Nov 09 01:09:53 user nova-compute[74441]: STATIC:
Nov 09 01:09:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:09:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79
Nov 09 01:09:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1
Nov 09 01:09:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:09:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:09:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:09:53 user nova-compute[74441]: FIRMWARE:
Nov 09 01:09:53 user nova-compute[74441]: No targets found.
Nov 09 01:09:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:09:53 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:09:53 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[468867df-d5bd-4051-a39e-da65e0bd9125]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9343a9a2-f13f-495b-998c-5b1399dc8d78]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:53 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:53 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:53 user nova-compute[74441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 (non-flash)
Nov 09 01:09:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:09:53 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:09:53 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:09:53 user nova-compute[74441]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 (non-flash)
Nov 09 01:09:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c49aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca30e0-0abd-4829-b2e9-09e0e529b822]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[977fbe50-db65-4c22-ba91-10322c1d5d49]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e9e944-8b13-43d9-b80b-a9d9e0f28442]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:09:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df96179-799f-4dd0-87ff-ccd7985c72e7]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[91890da6-1f56-4246-a27f-8e6497d02c2c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f12f9-8e3b-4e02-83fb-5af824ff8c55]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260]
Nov 09 01:09:54 user nova-compute[74441]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79, portal: 172.16.0.220,3260] successful.
Nov 09 01:09:54 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:997051d3-fab8-4ab6-8e58-cf2b91146a79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a24bf1-e798-4132-806b-8e2189fb928c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] <== disconnect_volume: return (313ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:09:54 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:09:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'flavor' on Instance uuid 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:09:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-1ab85a93-cb47-4619-9660-3efdf22fc4d8 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.981s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:09:56 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:09:56 user nova-compute[74441]: INFO nova.compute.claims [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Claim successful on node user
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:09:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:09:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:09:57 user nova-compute[74441]: INFO nova.virt.block_device [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Booting with volume-backed-image 8bb75127-e2cb-4fc7-b1f7-8e01f3707323 at /dev/vda
Nov 09 01:09:57 user nova-compute[74441]: DEBUG nova.policy [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffa1084de0be460fa924e3f124e47a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaf77bd26a3e4bb1831823704242a3b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:09:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Successfully created port: 8d5d6dcd-e973-4930-8421-60a98a93f7cc {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Successfully updated port: 8d5d6dcd-e973-4930-8421-60a98a93f7cc {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "refresh_cache-f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquired lock "refresh_cache-f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Received event network-changed-8d5d6dcd-e973-4930-8421-60a98a93f7cc {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Refreshing instance network info cache due to event network-changed-8d5d6dcd-e973-4930-8421-60a98a93f7cc. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] Acquiring lock "refresh_cache-f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Updating instance_info_cache with network_info: [{"id": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "address": "fa:16:3e:9a:2d:a7", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d6dcd-e9", "ovs_interfaceid": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Releasing lock "refresh_cache-f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Instance network_info: |[{"id": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "address": "fa:16:3e:9a:2d:a7", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d6dcd-e9", "ovs_interfaceid": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] Acquired lock "refresh_cache-f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:09:59 user nova-compute[74441]: DEBUG nova.network.neutron [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Refreshing network info cache for port 8d5d6dcd-e973-4930-8421-60a98a93f7cc {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:10:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Updated VIF entry in instance network info cache for port 8d5d6dcd-e973-4930-8421-60a98a93f7cc. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:10:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Updating instance_info_cache with network_info: [{"id": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "address": "fa:16:3e:9a:2d:a7", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d6dcd-e9", "ovs_interfaceid": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7d372627-5764-44f9-a3ce-dff25d65ef52 req-b95b4bd3-e2f3-43ac-bfc2-d4e32f7c21c1 service nova] Releasing lock "refresh_cache-f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [{"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-1a31fa46-141c-4685-9c9b-abf78eb549f9" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:10:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:10:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-changed-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:09 user nova-compute[74441]: DEBUG nova.compute.manager [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Refreshing instance network info cache due to event network-changed-6cbc638d-16c7-43b6-a4d9-3a68108fdd66. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:10:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] Acquiring lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:10:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] Acquired lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:10:09 user nova-compute[74441]: DEBUG nova.network.neutron [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Refreshing network info cache for port 6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:10:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:10 user nova-compute[74441]: DEBUG nova.network.neutron [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updated VIF entry in instance network info cache for port 6cbc638d-16c7-43b6-a4d9-3a68108fdd66. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:10:10 user nova-compute[74441]: DEBUG nova.network.neutron [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating instance_info_cache with network_info: [{"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-263ad50b-92b7-4ef2-b781-29aed4f61c33 req-1976ff45-f07a-4ca6-a086-3ce3dacad8bb service nova] Releasing lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-changed-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Refreshing instance network info cache due to event network-changed-6cbc638d-16c7-43b6-a4d9-3a68108fdd66. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] Acquiring lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] Acquired lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Refreshing network info cache for port 6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:11 user nova-compute[74441]: INFO nova.compute.manager [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Terminating instance
Nov 09 01:10:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updated VIF entry in instance network info cache for port 6cbc638d-16c7-43b6-a4d9-3a68108fdd66. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating instance_info_cache with network_info: [{"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4fe19d38-8e49-4819-8998-71c89bf41508 req-2d047cdb-1a46-44a6-899f-f5f8c86a341c service nova] Releasing lock "refresh_cache-2c5247d7-a8ce-4443-b3c1-72445c6c06ce" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:10:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Instance destroyed successfully.
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'resources' on Instance uuid 2c5247d7-a8ce-4443-b3c1-72445c6c06ce {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1660626130',display_name='tempest-TestVolumeBootPattern-server-1660626130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1660626130',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-jgnjb6p4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:08:49Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=2c5247d7-a8ce-4443-b3c1-72445c6c06ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "address": "fa:16:3e:f4:91:65", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc638d-16", "ovs_interfaceid": "6cbc638d-16c7-43b6-a4d9-3a68108fdd66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_vif [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cbc638d-16, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5734a2d-5e5a-4099-9a79-2d13b5a19504) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:12 user nova-compute[74441]: INFO os_vif [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:91:65,bridge_name='br-int',has_traffic_filtering=True,id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc638d-16')
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AravVIzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:10:12 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd20876-994c-449c-86be-6e4395661a71]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:10:12 user nova-compute[74441]: No targets found.
Nov 09 01:10:12 user nova-compute[74441]: iSNS:
Nov 09 01:10:12 user nova-compute[74441]: No targets found.
Nov 09 01:10:12 user nova-compute[74441]: STATIC:
Nov 09 01:10:12 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:10:12 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:10:12 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:10:12 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1
Nov 09 01:10:12 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:10:12 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:10:12 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:10:12 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:10:12 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:10:12 user nova-compute[74441]: FIRMWARE:
Nov 09 01:10:12 user nova-compute[74441]: No targets found.
Nov 09 01:10:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:10:12 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:10:12 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ec495-bfd1-4c6c-994c-148251f5240b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d769a0-53cc-4084-b4c9-3e22e6d16fd8]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:10:12 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:10:12 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:10:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:10:12 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:10:12 user nova-compute[74441]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 (non-flash)
Nov 09 01:10:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c57ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1'): ({'sdf'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Removing single pathed devices sdf {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d2a8d7-52c3-4187-a5ef-fd3c6edc9fa9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be95904-2017-4896-ac30-caa95e769aed]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flushing IO for device /dev/sdf {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7440aa1-e34e-45ee-ae82-d238c4763957]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e71f0e-6c44-488f-a51e-9a6116855e06]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] SCSI volumes sdf have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[331451f3-fe5d-4e2a-8d77-0dea0cd7f146]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[34453384-e5d6-4835-a1fa-d11736a10fdb]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260]
Nov 09 01:10:12 user nova-compute[74441]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1, portal: 172.16.0.220,3260] successful.
Nov 09 01:10:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7335396-552d-425e-8045-897a4f0cabc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2de433-3219-4eb0-a5ca-bdc849952ef8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== disconnect_volume: return (337ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:10:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Deleting instance files /opt/stack/data/nova/instances/2c5247d7-a8ce-4443-b3c1-72445c6c06ce_del
Nov 09 01:10:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Deletion of /opt/stack/data/nova/instances/2c5247d7-a8ce-4443-b3c1-72445c6c06ce_del complete
Nov 09 01:10:12 user nova-compute[74441]: INFO nova.compute.manager [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 09 01:10:12 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-5da3bfb6-3596-4d29-be57-9a1b68c07319 req-6756d9ea-edd1-4d38-8e34-5f862bcfa918 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-vif-deleted-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:12 user nova-compute[74441]: INFO nova.compute.manager [req-5da3bfb6-3596-4d29-be57-9a1b68c07319 req-6756d9ea-edd1-4d38-8e34-5f862bcfa918 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Neutron deleted interface 6cbc638d-16c7-43b6-a4d9-3a68108fdd66; detaching it from the instance and deleting it from the info cache
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.network.neutron [req-5da3bfb6-3596-4d29-be57-9a1b68c07319 req-6756d9ea-edd1-4d38-8e34-5f862bcfa918 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:12 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Took 0.49 seconds to deallocate network for instance.
Nov 09 01:10:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-5da3bfb6-3596-4d29-be57-9a1b68c07319 req-6756d9ea-edd1-4d38-8e34-5f862bcfa918 service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Detach interface failed, port_id=6cbc638d-16c7-43b6-a4d9-3a68108fdd66, reason: Instance 2c5247d7-a8ce-4443-b3c1-72445c6c06ce could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-vif-unplugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] No waiting events found dispatching network-vif-unplugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-vif-unplugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received event network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] Acquiring lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] No waiting events found dispatching network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:13 user nova-compute[74441]: WARNING nova.compute.manager [req-4b11ff25-c8d9-4c81-8cd8-facc707f0373 req-6c1f779c-5de3-411e-a6f0-d180bf3c0f0d service nova] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Received unexpected event network-vif-plugged-6cbc638d-16c7-43b6-a4d9-3a68108fdd66 for instance with vm_state active and task_state deleting.
Nov 09 01:10:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:10:19 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8387MB free_disk=24.83403778076172GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 19f2dd9e-c2f4-4117-a53d-109679326aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d7483b9f-709b-4409-88bf-1adc3d51ac90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 2c5247d7-a8ce-4443-b3c1-72445c6c06ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance f969b5d7-7d96-4aef-9b48-fe7e6937cb1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:10:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.652s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:23 user nova-compute[74441]: INFO nova.compute.manager [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Terminating instance
Nov 09 01:10:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_brick.utils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b8644-e149-41ee-ae5f-700625f2f6c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-9dbc5ba7-1337-4e1f-8d96-062bf3c82710 req-01b7ddc9-0961-4e2a-bff7-6a135ed4eb21 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-unplugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9dbc5ba7-1337-4e1f-8d96-062bf3c82710 req-01b7ddc9-0961-4e2a-bff7-6a135ed4eb21 service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9dbc5ba7-1337-4e1f-8d96-062bf3c82710 req-01b7ddc9-0961-4e2a-bff7-6a135ed4eb21 service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-9dbc5ba7-1337-4e1f-8d96-062bf3c82710 req-01b7ddc9-0961-4e2a-bff7-6a135ed4eb21 service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-9dbc5ba7-1337-4e1f-8d96-062bf3c82710 req-01b7ddc9-0961-4e2a-bff7-6a135ed4eb21 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-unplugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.compute.manager [req-9dbc5ba7-1337-4e1f-8d96-062bf3c82710 req-01b7ddc9-0961-4e2a-bff7-6a135ed4eb21 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-unplugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab074df-5dff-4504-9dab-04051fe42944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8cbbb5-6e1d-41b7-8f8e-64a63dd6d35a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf0ea1-e758-473e-8d48-c33f49e71cf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:10:24 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2d0c79-e571-49d6-ae46-2ee24f426680]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_brick.utils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Updating existing volume attachment record: 87288f70-2a34-4b74-9972-db5763dd3ce2 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Instance destroyed successfully.
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lazy-loading 'resources' on Instance uuid 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:06:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1459417391',display_name='tempest-AttachVolumeNegativeTest-server-1459417391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1459417391',id=39,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHWR0TMFceu7LcD450/Jcw25jR81i97tXXyUEiFk2ZemJOdXYNSTs6kw3tI5MwDE0IIY0IBzenbsVQUCE9c09yD8/3UniPzrLswC5PL9vRNpA1lT/YILZ1aaYuc5QyxKw==',key_name='tempest-keypair-1152033868',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e49bf75726243749bace44e94c1397b',ramdisk_id='',reservation_id='r-gd9tudax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-595140925',owner_user_name='tempest-AttachVolumeNegativeTest-595140925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='156577f25fe04e6e8ac3612c2a0dbc4d',uuid=63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converting VIF {"id": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "address": "fa:16:3e:55:92:6e", "network": {"id": "7a62372a-fab8-4e06-9a9f-078eba1e5728", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-605492874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e49bf75726243749bace44e94c1397b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25fe7b32-73", "ovs_interfaceid": "25fe7b32-7327-4f43-b342-eeb0498a90b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG os_vif [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25fe7b32-73, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1059942b-4658-4a5a-b1eb-fb366424b1c4) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:24 user nova-compute[74441]: INFO os_vif [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:92:6e,bridge_name='br-int',has_traffic_filtering=True,id=25fe7b32-7327-4f43-b342-eeb0498a90b4,network=Network(7a62372a-fab8-4e06-9a9f-078eba1e5728),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25fe7b32-73')
Nov 09 01:10:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Deleting instance files /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7_del
Nov 09 01:10:24 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Deletion of /opt/stack/data/nova/instances/63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7_del complete
Nov 09 01:10:24 user nova-compute[74441]: INFO nova.compute.manager [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 09 01:10:24 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:10:24 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:25 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Took 0.93 seconds to deallocate network for instance.
Nov 09 01:10:25 user nova-compute[74441]: DEBUG nova.compute.manager [req-b34f69a6-a14f-4ff4-84b9-dae6a64b1d4e req-3479c292-a923-483e-9253-ae52bffba601 service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-deleted-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:10:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Deleted allocations for instance 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a782b283-4753-4890-87c4-d5a9de4d93e3 tempest-AttachVolumeNegativeTest-595140925 tempest-AttachVolumeNegativeTest-595140925-project-member] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.469s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:26 user nova-compute[74441]: WARNING nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state deleted and task_state None.
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:26 user nova-compute[74441]: WARNING nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state deleted and task_state None.
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:26 user nova-compute[74441]: WARNING nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state deleted and task_state None.
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-unplugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-unplugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:26 user nova-compute[74441]: WARNING nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-unplugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state deleted and task_state None.
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Acquiring lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] Lock "63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:26 user nova-compute[74441]: DEBUG nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] No waiting events found dispatching network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:26 user nova-compute[74441]: WARNING nova.compute.manager [req-5b5555ce-2d40-4883-880f-47ff443afb96 req-e707dc40-63bc-4c93-a8a7-141d20092f9c service nova] [instance: 63e0ada4-2a5e-4eee-a5f1-57ca12aa69d7] Received unexpected event network-vif-plugged-25fe7b32-7327-4f43-b342-eeb0498a90b4 for instance with vm_state deleted and task_state None.
Nov 09 01:10:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:34 user nova-compute[74441]: INFO nova.compute.manager [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 2c5247d7-a8ce-4443-b3c1-72445c6c06ce] Took 21.28 seconds to detach 1 volumes for instance.
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:34 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Deleted allocations for instance 2c5247d7-a8ce-4443-b3c1-72445c6c06ce
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.volume.cinder [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Update attachment failed for attachment 87288f70-2a34-4b74-9972-db5763dd3ce2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Traceback (most recent call last):
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     driver_block_device.attach_block_devices(
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     _log_and_attach(device)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     bdm.attach(*attach_args, **attach_kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 835, in attach
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     super(DriverVolImageBlockDevice, self).attach(
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     self._do_attach(context, instance, volume, volume_api,
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     self._volume_attach(context, volume, connector, instance,
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     connection_info = volume_api.attachment_update(
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     res = method(self, ctx, *args, **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     with excutils.save_and_reraise_exception():
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     self.force_reraise()
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     raise self.value
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     return method.func(obj, *args, **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     resp = self._update('/attachments/%s' % id, body)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     return self.request(url, method, **kwargs)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e]     raise exceptions.from_response(resp, body)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455)
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] 
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.claims [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Aborting claim: <nova.compute.claims.Claim object at 0x7f013c68ee60> {{(pid=74441) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-012e93c5-1f28-43be-8b26-e107f7561bea tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "2c5247d7-a8ce-4443-b3c1-72445c6c06ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.418s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.286s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Build of instance f969b5d7-7d96-4aef-9b48-fe7e6937cb1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455) {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.utils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Build of instance f969b5d7-7d96-4aef-9b48-fe7e6937cb1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74441) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 09 01:10:34 user nova-compute[74441]: ERROR nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Build of instance f969b5d7-7d96-4aef-9b48-fe7e6937cb1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455): nova.exception.BuildAbortException: Build of instance f969b5d7-7d96-4aef-9b48-fe7e6937cb1e aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2643074f-3399-4e76-8979-0a7fee3e7455)
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Unplugging VIFs for instance {{(pid=74441) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2016707888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2016707888',id=43,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-u0qjatf3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:09:58Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=f969b5d7-7d96-4aef-9b48-fe7e6937cb1e,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "address": "fa:16:3e:9a:2d:a7", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d6dcd-e9", "ovs_interfaceid": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "address": "fa:16:3e:9a:2d:a7", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5d6dcd-e9", "ovs_interfaceid": "8d5d6dcd-e973-4930-8421-60a98a93f7cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=8d5d6dcd-e973-4930-8421-60a98a93f7cc,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5d6dcd-e9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG os_vif [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=8d5d6dcd-e973-4930-8421-60a98a93f7cc,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5d6dcd-e9') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d5d6dcd-e9, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:10:34 user nova-compute[74441]: INFO os_vif [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:2d:a7,bridge_name='br-int',has_traffic_filtering=True,id=8d5d6dcd-e973-4930-8421-60a98a93f7cc,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5d6dcd-e9')
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Unplugged VIFs for instance {{(pid=74441) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:10:34 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:10:35 user nova-compute[74441]: DEBUG nova.network.neutron [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:35 user nova-compute[74441]: INFO nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Took 0.48 seconds to deallocate network for instance.
Nov 09 01:10:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Detaching volume: a8bea9d8-df40-4f83-9f3d-76c45bb9ca5d {{(pid=74441) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 09 01:10:35 user nova-compute[74441]: INFO nova.compute.manager [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Detaching volume a8bea9d8-df40-4f83-9f3d-76c45bb9ca5d
Nov 09 01:10:35 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: f969b5d7-7d96-4aef-9b48-fe7e6937cb1e] Skipping driver_detach during remote rebuild. {{(pid=74441) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 09 01:10:35 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Deleted allocations for instance f969b5d7-7d96-4aef-9b48-fe7e6937cb1e
Nov 09 01:10:35 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2887260b-757c-4a6f-a422-c29ac2526426 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "f969b5d7-7d96-4aef-9b48-fe7e6937cb1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.857s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:47 user nova-compute[74441]: INFO nova.compute.manager [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Terminating instance
Nov 09 01:10:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG nova.compute.manager [req-71373f52-8ddf-460f-9a20-8b6067aed072 req-78e05fa4-46bf-46e2-aa02-a0551477c184 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-vif-unplugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71373f52-8ddf-460f-9a20-8b6067aed072 req-78e05fa4-46bf-46e2-aa02-a0551477c184 service nova] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71373f52-8ddf-460f-9a20-8b6067aed072 req-78e05fa4-46bf-46e2-aa02-a0551477c184 service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71373f52-8ddf-460f-9a20-8b6067aed072 req-78e05fa4-46bf-46e2-aa02-a0551477c184 service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG nova.compute.manager [req-71373f52-8ddf-460f-9a20-8b6067aed072 req-78e05fa4-46bf-46e2-aa02-a0551477c184 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] No waiting events found dispatching network-vif-unplugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG nova.compute.manager [req-71373f52-8ddf-460f-9a20-8b6067aed072 req-78e05fa4-46bf-46e2-aa02-a0551477c184 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-vif-unplugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Instance destroyed successfully.
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.objects.instance [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'resources' on Instance uuid d7483b9f-709b-4409-88bf-1adc3d51ac90 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1783853293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1783853293',id=40,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-bhbgfj90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:08:55Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=d7483b9f-709b-4409-88bf-1adc3d51ac90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "address": "fa:16:3e:ee:77:f6", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dfd219b-48", "ovs_interfaceid": "1dfd219b-4826-45f4-a354-4b0353c8d7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG os_vif [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dfd219b-48, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1970e52-1cbb-4f4d-a210-a23935249e6b) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:48 user nova-compute[74441]: INFO os_vif [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:77:f6,bridge_name='br-int',has_traffic_filtering=True,id=1dfd219b-4826-45f4-a354-4b0353c8d7b3,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dfd219b-48')
Nov 09 01:10:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Deleting instance files /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90_del
Nov 09 01:10:48 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Deletion of /opt/stack/data/nova/instances/d7483b9f-709b-4409-88bf-1adc3d51ac90_del complete
Nov 09 01:10:48 user nova-compute[74441]: INFO nova.compute.manager [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 09 01:10:48 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:10:48 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Took 0.42 seconds to deallocate network for instance.
Nov 09 01:10:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:10:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:48 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Deleted allocations for instance d7483b9f-709b-4409-88bf-1adc3d51ac90
Nov 09 01:10:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-22110018-1f24-4028-8e47-fcba189f7765 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.532s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:49 user nova-compute[74441]: DEBUG nova.compute.manager [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] Acquiring lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:10:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:10:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] Lock "d7483b9f-709b-4409-88bf-1adc3d51ac90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:10:49 user nova-compute[74441]: DEBUG nova.compute.manager [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] No waiting events found dispatching network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:10:49 user nova-compute[74441]: WARNING nova.compute.manager [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received unexpected event network-vif-plugged-1dfd219b-4826-45f4-a354-4b0353c8d7b3 for instance with vm_state deleted and task_state None.
Nov 09 01:10:49 user nova-compute[74441]: DEBUG nova.compute.manager [req-65ad29ea-3f1d-4aa5-8279-eee9607d963a req-7e78a767-4882-45b2-bf2a-5a987cb3c562 service nova] [instance: d7483b9f-709b-4409-88bf-1adc3d51ac90] Received event network-vif-deleted-1dfd219b-4826-45f4-a354-4b0353c8d7b3 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:10:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:10:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:11:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:11:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquired lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'info_cache' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG nova.network.neutron [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Releasing lock "refresh_cache-d64a477e-66b2-48b9-886d-ca146148167a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:11:11 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance destroyed successfully.
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'resources' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG os_vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65db9fd8-e6, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d83fda27-ec2d-4ab2-aca6-fe6ac75d6e95) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:11 user nova-compute[74441]: INFO os_vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6')
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start _get_guest_xml network_info=[{"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'numa_topology' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:11 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:11:11 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'vcpu_model' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'pci_devices' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:11:11 user nova-compute[74441]:   <uuid>d64a477e-66b2-48b9-886d-ca146148167a</uuid>
Nov 09 01:11:11 user nova-compute[74441]:   <name>instance-00000025</name>
Nov 09 01:11:11 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:11:11 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:11:11 user nova-compute[74441]:   <metadata>
Nov 09 01:11:11 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:11:11 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:11:11 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1798271286</nova:name>
Nov 09 01:11:11 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:11:11</nova:creationTime>
Nov 09 01:11:11 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:11:11 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:11:11 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:11:11 user nova-compute[74441]:       <nova:owner>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:user uuid="9d6713a112a64d03a7cd67c304a85ddd">tempest-AttachVolumeTestJSON-1454008029-project-member</nova:user>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:project uuid="01aa9979e78d4597ae023610b56f5a60">tempest-AttachVolumeTestJSON-1454008029</nova:project>
Nov 09 01:11:11 user nova-compute[74441]:       </nova:owner>
Nov 09 01:11:11 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:11:11 user nova-compute[74441]:       <nova:ports>
Nov 09 01:11:11 user nova-compute[74441]:         <nova:port uuid="65db9fd8-e6f2-41f5-9bcc-e52d93471f61">
Nov 09 01:11:11 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 01:11:11 user nova-compute[74441]:         </nova:port>
Nov 09 01:11:11 user nova-compute[74441]:       </nova:ports>
Nov 09 01:11:11 user nova-compute[74441]:     </nova:instance>
Nov 09 01:11:11 user nova-compute[74441]:   </metadata>
Nov 09 01:11:11 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:11:11 user nova-compute[74441]:     <system>
Nov 09 01:11:11 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:11:11 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:11:11 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:11:11 user nova-compute[74441]:       <entry name="serial">d64a477e-66b2-48b9-886d-ca146148167a</entry>
Nov 09 01:11:11 user nova-compute[74441]:       <entry name="uuid">d64a477e-66b2-48b9-886d-ca146148167a</entry>
Nov 09 01:11:11 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:11:11 user nova-compute[74441]:     </system>
Nov 09 01:11:11 user nova-compute[74441]:   </sysinfo>
Nov 09 01:11:11 user nova-compute[74441]:   <os>
Nov 09 01:11:11 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:11:11 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:11:11 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:11:11 user nova-compute[74441]:   </os>
Nov 09 01:11:11 user nova-compute[74441]:   <features>
Nov 09 01:11:11 user nova-compute[74441]:     <acpi/>
Nov 09 01:11:11 user nova-compute[74441]:     <apic/>
Nov 09 01:11:11 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:11:11 user nova-compute[74441]:   </features>
Nov 09 01:11:11 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:11:11 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:11:11 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:11:11 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:11:11 user nova-compute[74441]:   </clock>
Nov 09 01:11:11 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:11:11 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:11:11 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:11:11 user nova-compute[74441]:   </cpu>
Nov 09 01:11:11 user nova-compute[74441]:   <devices>
Nov 09 01:11:11 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:11:11 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:11:11 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk"/>
Nov 09 01:11:11 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:11:11 user nova-compute[74441]:     </disk>
Nov 09 01:11:11 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:11:11 user nova-compute[74441]:       <mac address="fa:16:3e:d7:35:97"/>
Nov 09 01:11:11 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:11:11 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:11:11 user nova-compute[74441]:       <target dev="tap65db9fd8-e6"/>
Nov 09 01:11:11 user nova-compute[74441]:     </interface>
Nov 09 01:11:11 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:11:11 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/console.log" append="off"/>
Nov 09 01:11:11 user nova-compute[74441]:     </serial>
Nov 09 01:11:11 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:11:11 user nova-compute[74441]:     <video>
Nov 09 01:11:11 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:11:11 user nova-compute[74441]:     </video>
Nov 09 01:11:11 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:11:11 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:11:11 user nova-compute[74441]:     </rng>
Nov 09 01:11:11 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:11:11 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:11:11 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:11:11 user nova-compute[74441]:     </memballoon>
Nov 09 01:11:11 user nova-compute[74441]:   </devices>
Nov 09 01:11:11 user nova-compute[74441]: </domain>
Nov 09 01:11:11 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:11:11 user nova-compute[74441]: INFO nova.compute.claims [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Claim successful on node user
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'trusted_certs' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.neutron [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:11:11 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.policy [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96586584970e41a7be230fa812eee595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8cfa05f08e4a99adff754a174b6e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Cannot resize image /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.instance [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'migration_context' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.objects.base [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Object Instance<d64a477e-66b2-48b9-886d-ca146148167a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74441) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:09:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG os_vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e96a1d2f-03c5-57a5-b7ae-a530132e93c8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65db9fd8-e6, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65db9fd8-e6, col_values=(('qos', UUID('15e8bc0b-537f-4c2a-b4f9-a62b075ff57a')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65db9fd8-e6, col_values=(('external_ids', {'iface-id': '65db9fd8-e6f2-41f5-9bcc-e52d93471f61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:35:97', 'vm-uuid': 'd64a477e-66b2-48b9-886d-ca146148167a'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:11 user nova-compute[74441]: INFO os_vif [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6')
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:11:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Creating image(s)
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "/opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "/opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "/opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk 1073741824" returned: 0 in 0.055s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Successfully created port: 96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Cannot resize image /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Ensure instance console log exists: /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Successfully updated port: 96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-changed-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Refreshing instance network info cache due to event network-changed-96af8899-9fcd-4ad9-ac8d-f08f81e85f93. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-ad655126-f53d-4513-b9cb-4dda23a224d2 req-919611a8-e158-45e2-9353-39e1b95199e1 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ad655126-f53d-4513-b9cb-4dda23a224d2 req-919611a8-e158-45e2-9353-39e1b95199e1 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ad655126-f53d-4513-b9cb-4dda23a224d2 req-919611a8-e158-45e2-9353-39e1b95199e1 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ad655126-f53d-4513-b9cb-4dda23a224d2 req-919611a8-e158-45e2-9353-39e1b95199e1 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-ad655126-f53d-4513-b9cb-4dda23a224d2 req-919611a8-e158-45e2-9353-39e1b95199e1 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:13 user nova-compute[74441]: WARNING nova.compute.manager [req-ad655126-f53d-4513-b9cb-4dda23a224d2 req-919611a8-e158-45e2-9353-39e1b95199e1 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state stopped and task_state powering-on.
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Instance network_info: |[{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Refreshing network info cache for port 96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Start _get_guest_xml network_info=[{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:11:14 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:11:14 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-220303619',display_name='tempest-TestStampPattern-server-220303619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-220303619',id=44,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo7/pO4zSR1ADroCCg2eqYQ9pbvdCL5YyDK/eyYN9sApBRkwrLnAHtd5EEOhoWcsdQ5yZW+/68PtpdGs1Y/XPdTufNmckviqD07G4Xfbq1cpMUUyQzuCUmFoGCYG99Qng==',key_name='tempest-TestStampPattern-181357963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8cfa05f08e4a99adff754a174b6e42',ramdisk_id='',reservation_id='r-32lpjpcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1784819717',owner_user_name='tempest-TestStampPattern-1784819717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:11:12Z,user_data=None,user_id='96586584970e41a7be230fa812eee595',uuid=0558985f-65a5-49b7-8f2f-147dd3b029b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converting VIF {"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.objects.instance [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'pci_devices' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:11:14 user nova-compute[74441]:   <uuid>0558985f-65a5-49b7-8f2f-147dd3b029b8</uuid>
Nov 09 01:11:14 user nova-compute[74441]:   <name>instance-0000002c</name>
Nov 09 01:11:14 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:11:14 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:11:14 user nova-compute[74441]:   <metadata>
Nov 09 01:11:14 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:11:14 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:11:14 user nova-compute[74441]:       <nova:name>tempest-TestStampPattern-server-220303619</nova:name>
Nov 09 01:11:14 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:11:14</nova:creationTime>
Nov 09 01:11:14 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:11:14 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:11:14 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:11:14 user nova-compute[74441]:       <nova:owner>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:user uuid="96586584970e41a7be230fa812eee595">tempest-TestStampPattern-1784819717-project-member</nova:user>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:project uuid="2c8cfa05f08e4a99adff754a174b6e42">tempest-TestStampPattern-1784819717</nova:project>
Nov 09 01:11:14 user nova-compute[74441]:       </nova:owner>
Nov 09 01:11:14 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:11:14 user nova-compute[74441]:       <nova:ports>
Nov 09 01:11:14 user nova-compute[74441]:         <nova:port uuid="96af8899-9fcd-4ad9-ac8d-f08f81e85f93">
Nov 09 01:11:14 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 01:11:14 user nova-compute[74441]:         </nova:port>
Nov 09 01:11:14 user nova-compute[74441]:       </nova:ports>
Nov 09 01:11:14 user nova-compute[74441]:     </nova:instance>
Nov 09 01:11:14 user nova-compute[74441]:   </metadata>
Nov 09 01:11:14 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:11:14 user nova-compute[74441]:     <system>
Nov 09 01:11:14 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:11:14 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:11:14 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:11:14 user nova-compute[74441]:       <entry name="serial">0558985f-65a5-49b7-8f2f-147dd3b029b8</entry>
Nov 09 01:11:14 user nova-compute[74441]:       <entry name="uuid">0558985f-65a5-49b7-8f2f-147dd3b029b8</entry>
Nov 09 01:11:14 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:11:14 user nova-compute[74441]:     </system>
Nov 09 01:11:14 user nova-compute[74441]:   </sysinfo>
Nov 09 01:11:14 user nova-compute[74441]:   <os>
Nov 09 01:11:14 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:11:14 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:11:14 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:11:14 user nova-compute[74441]:   </os>
Nov 09 01:11:14 user nova-compute[74441]:   <features>
Nov 09 01:11:14 user nova-compute[74441]:     <acpi/>
Nov 09 01:11:14 user nova-compute[74441]:     <apic/>
Nov 09 01:11:14 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:11:14 user nova-compute[74441]:   </features>
Nov 09 01:11:14 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:11:14 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:11:14 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:11:14 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:11:14 user nova-compute[74441]:   </clock>
Nov 09 01:11:14 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:11:14 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:11:14 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:11:14 user nova-compute[74441]:   </cpu>
Nov 09 01:11:14 user nova-compute[74441]:   <devices>
Nov 09 01:11:14 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:11:14 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:11:14 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk"/>
Nov 09 01:11:14 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:11:14 user nova-compute[74441]:     </disk>
Nov 09 01:11:14 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:11:14 user nova-compute[74441]:       <mac address="fa:16:3e:a2:33:2c"/>
Nov 09 01:11:14 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:11:14 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:11:14 user nova-compute[74441]:       <target dev="tap96af8899-9f"/>
Nov 09 01:11:14 user nova-compute[74441]:     </interface>
Nov 09 01:11:14 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:11:14 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/console.log" append="off"/>
Nov 09 01:11:14 user nova-compute[74441]:     </serial>
Nov 09 01:11:14 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:11:14 user nova-compute[74441]:     <video>
Nov 09 01:11:14 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:11:14 user nova-compute[74441]:     </video>
Nov 09 01:11:14 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:11:14 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:11:14 user nova-compute[74441]:     </rng>
Nov 09 01:11:14 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:11:14 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:11:14 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:11:14 user nova-compute[74441]:     </memballoon>
Nov 09 01:11:14 user nova-compute[74441]:   </devices>
Nov 09 01:11:14 user nova-compute[74441]: </domain>
Nov 09 01:11:14 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-220303619',display_name='tempest-TestStampPattern-server-220303619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-220303619',id=44,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo7/pO4zSR1ADroCCg2eqYQ9pbvdCL5YyDK/eyYN9sApBRkwrLnAHtd5EEOhoWcsdQ5yZW+/68PtpdGs1Y/XPdTufNmckviqD07G4Xfbq1cpMUUyQzuCUmFoGCYG99Qng==',key_name='tempest-TestStampPattern-181357963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8cfa05f08e4a99adff754a174b6e42',ramdisk_id='',reservation_id='r-32lpjpcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1784819717',owner_user_name='tempest-TestStampPattern-1784819717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:11:12Z,user_data=None,user_id='96586584970e41a7be230fa812eee595',uuid=0558985f-65a5-49b7-8f2f-147dd3b029b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converting VIF {"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG os_vif [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17de3081-1968-52ad-b4e9-4e77234474a1', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96af8899-9f, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96af8899-9f, col_values=(('qos', UUID('d31b6dd4-9acd-478b-b48b-0ef753585686')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96af8899-9f, col_values=(('external_ids', {'iface-id': '96af8899-9fcd-4ad9-ac8d-f08f81e85f93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:33:2c', 'vm-uuid': '0558985f-65a5-49b7-8f2f-147dd3b029b8'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: INFO os_vif [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f')
Nov 09 01:11:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No VIF found with MAC fa:16:3e:a2:33:2c, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updated VIF entry in instance network info cache for port 96af8899-9fcd-4ad9-ac8d-f08f81e85f93. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG nova.network.neutron [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-62f0d070-52c1-4f0b-b10a-9c47bc271442 req-07b9dd73-9ae6-4dc9-b5ea-2f0efd8570b6 service nova] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-0c48b363-cf3e-4e8f-bc7a-57f0e23d637c req-4b104d1a-dac5-4f49-913c-3f2d13e279f1 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0c48b363-cf3e-4e8f-bc7a-57f0e23d637c req-4b104d1a-dac5-4f49-913c-3f2d13e279f1 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0c48b363-cf3e-4e8f-bc7a-57f0e23d637c req-4b104d1a-dac5-4f49-913c-3f2d13e279f1 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-0c48b363-cf3e-4e8f-bc7a-57f0e23d637c req-4b104d1a-dac5-4f49-913c-3f2d13e279f1 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-0c48b363-cf3e-4e8f-bc7a-57f0e23d637c req-4b104d1a-dac5-4f49-913c-3f2d13e279f1 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:15 user nova-compute[74441]: WARNING nova.compute.manager [req-0c48b363-cf3e-4e8f-bc7a-57f0e23d637c req-4b104d1a-dac5-4f49-913c-3f2d13e279f1 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state stopped and task_state powering-on.
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:11:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance rebooted successfully.
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-5bba7e69-20e3-4bd2-8610-ced1717359b0 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-79e63b6e-87f7-480c-bf37-885e608b4995 req-49a5cd5f-cbd6-4d07-88e7-b855426fb613 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-79e63b6e-87f7-480c-bf37-885e608b4995 req-49a5cd5f-cbd6-4d07-88e7-b855426fb613 service nova] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-79e63b6e-87f7-480c-bf37-885e608b4995 req-49a5cd5f-cbd6-4d07-88e7-b855426fb613 service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-79e63b6e-87f7-480c-bf37-885e608b4995 req-49a5cd5f-cbd6-4d07-88e7-b855426fb613 service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-79e63b6e-87f7-480c-bf37-885e608b4995 req-49a5cd5f-cbd6-4d07-88e7-b855426fb613 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] No waiting events found dispatching network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:15 user nova-compute[74441]: WARNING nova.compute.manager [req-79e63b6e-87f7-480c-bf37-885e608b4995 req-49a5cd5f-cbd6-4d07-88e7-b855426fb613 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received unexpected event network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 for instance with vm_state building and task_state spawning.
Nov 09 01:11:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-3c1d4a1e-1749-4a57-93f9-542b65a76c6e req-cae38206-eabf-4faf-b5cb-88bbe02e146a service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c1d4a1e-1749-4a57-93f9-542b65a76c6e req-cae38206-eabf-4faf-b5cb-88bbe02e146a service nova] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c1d4a1e-1749-4a57-93f9-542b65a76c6e req-cae38206-eabf-4faf-b5cb-88bbe02e146a service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c1d4a1e-1749-4a57-93f9-542b65a76c6e req-cae38206-eabf-4faf-b5cb-88bbe02e146a service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-3c1d4a1e-1749-4a57-93f9-542b65a76c6e req-cae38206-eabf-4faf-b5cb-88bbe02e146a service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] No waiting events found dispatching network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:18 user nova-compute[74441]: WARNING nova.compute.manager [req-3c1d4a1e-1749-4a57-93f9-542b65a76c6e req-cae38206-eabf-4faf-b5cb-88bbe02e146a service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received unexpected event network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 for instance with vm_state building and task_state spawning.
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:11:18 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Instance spawned successfully.
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:11:18 user nova-compute[74441]: INFO nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:18 user nova-compute[74441]: INFO nova.compute.manager [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Took 7.18 seconds to build instance.
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-61cd8336-99d0-40e0-8fa3-24e83d5f635f tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.283s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:20 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:11:20 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=24.925086975097656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1a31fa46-141c-4685-9c9b-abf78eb549f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 19f2dd9e-c2f4-4117-a53d-109679326aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:11:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:11:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:11:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:11:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:11:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-changed-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Refreshing instance network info cache due to event network-changed-9afac105-0e2a-412c-b715-a90e4ae4aa76. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:11:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] Acquiring lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:11:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] Acquired lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:11:31 user nova-compute[74441]: DEBUG nova.network.neutron [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Refreshing network info cache for port 9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:32 user nova-compute[74441]: INFO nova.compute.manager [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Terminating instance
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updated VIF entry in instance network info cache for port 9afac105-0e2a-412c-b715-a90e4ae4aa76. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.network.neutron [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updating instance_info_cache with network_info: [{"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3c3d9689-890e-4b19-8005-f134b0e4c7a5 req-66f61ce8-1d3a-4fe9-8c87-5fd5d5899261 service nova] Releasing lock "refresh_cache-19f2dd9e-c2f4-4117-a53d-109679326aee" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:11:32 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Instance destroyed successfully.
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.objects.instance [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lazy-loading 'resources' on Instance uuid 19f2dd9e-c2f4-4117-a53d-109679326aee {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-487033461',display_name='tempest-TestVolumeBootPattern-server-487033461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-487033461',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMnhhWCDhykPq3mAxjdXUlPaNKpKWStRUKlR7+puLkSnu1CoB/lKjRzKL7pNqpHcsLKntDHmP750RxfhTsWmMKHPW6XQmrobl/u0qbNbAAo/qPERChC90EBWo69pYgilg==',key_name='tempest-TestVolumeBootPattern-1911721114',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad9194fd2e7248a2bdbfd3d57f846fed',ramdisk_id='',reservation_id='r-7pnacq87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1724241999',owner_user_name='tempest-TestVolumeBootPattern-1724241999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:06:15Z,user_data=None,user_id='d80ab02de6b249c3adecf0597940ea76',uuid=19f2dd9e-c2f4-4117-a53d-109679326aee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converting VIF {"id": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "address": "fa:16:3e:00:59:8f", "network": {"id": "1c800560-0d0b-4232-8398-15c9e263f90a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1407292922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9194fd2e7248a2bdbfd3d57f846fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9afac105-0e", "ovs_interfaceid": "9afac105-0e2a-412c-b715-a90e4ae4aa76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_vif [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9afac105-0e, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56c06496-c938-4e42-9a15-51d047016ea5) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:32 user nova-compute[74441]: INFO os_vif [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:59:8f,bridge_name='br-int',has_traffic_filtering=True,id=9afac105-0e2a-412c-b715-a90e4ae4aa76,network=Network(1c800560-0d0b-4232-8398-15c9e263f90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9afac105-0e')
Nov 09 01:11:32 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BQhvTbkH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:11:32 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbe734b-9393-4626-8ce1-3439959a00e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:11:32 user nova-compute[74441]: No targets found.
Nov 09 01:11:32 user nova-compute[74441]: iSNS:
Nov 09 01:11:32 user nova-compute[74441]: No targets found.
Nov 09 01:11:32 user nova-compute[74441]: STATIC:
Nov 09 01:11:32 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a
Nov 09 01:11:32 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:11:32 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:11:32 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:11:32 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:11:32 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:11:32 user nova-compute[74441]: FIRMWARE:
Nov 09 01:11:32 user nova-compute[74441]: No targets found.
Nov 09 01:11:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:11:32 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:11:32 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29fc4a-1c86-4177-acad-0075cc1a6a24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a36b545-8e4f-48bc-9bf9-1ae24ec46469]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:11:32 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:11:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:11:32 user nova-compute[74441]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a (non-flash)
Nov 09 01:11:32 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c5816c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:11:32 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d79ea-a853-45a1-b2c5-25c17e9d138f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ea315-3da1-4f7a-867d-c0288e0b34a0]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6226c5b4-4d7d-48b5-84f6-726ebf84a4fb]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef22e4e0-c504-4d6b-822a-2cc5cc2aacd2]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO67184d89-e1621ef2b242d39b', '/dev/disk/by-id/scsi-26531363231656632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_67184d89') {{(pid=85292) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ace808b-a963-4126-89ac-30cec34dbd71]: (4, None) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188a098-d2ee-41c9-81c4-f61f66a0cf64]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.172s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde14d0-5df8-40b2-9abd-0821615b6c12]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260]
Nov 09 01:11:33 user nova-compute[74441]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a, portal: 172.16.0.220,3260] successful.
Nov 09 01:11:33 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6735b743-7c32-4e88-bb56-8d21b3592c8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[570947c4-90d9-444b-805d-94acd9718bd4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] <== disconnect_volume: return (438ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:11:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Deleting instance files /opt/stack/data/nova/instances/19f2dd9e-c2f4-4117-a53d-109679326aee_del
Nov 09 01:11:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Deletion of /opt/stack/data/nova/instances/19f2dd9e-c2f4-4117-a53d-109679326aee_del complete
Nov 09 01:11:33 user nova-compute[74441]: INFO nova.compute.manager [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:33 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Took 0.51 seconds to deallocate network for instance.
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-a32c70df-e199-4b93-83a8-3fb808050988 req-e9b381d4-e020-458d-a124-f099bf14c034 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-vif-deleted-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-vif-unplugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] No waiting events found dispatching network-vif-unplugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-vif-unplugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received event network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] Acquiring lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:33 user nova-compute[74441]: DEBUG nova.compute.manager [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] No waiting events found dispatching network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:33 user nova-compute[74441]: WARNING nova.compute.manager [req-66c46089-f667-4c26-9ef4-12a362341b7a req-38dd1e49-4bfc-4ad0-bf41-d4dac20644d9 service nova] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Received unexpected event network-vif-plugged-9afac105-0e2a-412c-b715-a90e4ae4aa76 for instance with vm_state active and task_state deleting.
Nov 09 01:11:37 user nova-compute[74441]: INFO nova.compute.manager [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] [instance: 19f2dd9e-c2f4-4117-a53d-109679326aee] Took 3.12 seconds to detach 1 volumes for instance.
Nov 09 01:11:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:37 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:11:37 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:11:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:37 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Deleted allocations for instance 19f2dd9e-c2f4-4117-a53d-109679326aee
Nov 09 01:11:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-6d84d1c9-0e4d-4543-a56d-bb8aa1fddaa4 tempest-TestVolumeBootPattern-1724241999 tempest-TestVolumeBootPattern-1724241999-project-member] Lock "19f2dd9e-c2f4-4117-a53d-109679326aee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.475s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:38 user nova-compute[74441]: INFO nova.compute.manager [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Terminating instance
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-ac995ef1-6aed-4dd5-903b-1f9915647c35 req-962d0e63-df9f-492c-9b32-6398a3116834 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ac995ef1-6aed-4dd5-903b-1f9915647c35 req-962d0e63-df9f-492c-9b32-6398a3116834 service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ac995ef1-6aed-4dd5-903b-1f9915647c35 req-962d0e63-df9f-492c-9b32-6398a3116834 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ac995ef1-6aed-4dd5-903b-1f9915647c35 req-962d0e63-df9f-492c-9b32-6398a3116834 service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-ac995ef1-6aed-4dd5-903b-1f9915647c35 req-962d0e63-df9f-492c-9b32-6398a3116834 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-ac995ef1-6aed-4dd5-903b-1f9915647c35 req-962d0e63-df9f-492c-9b32-6398a3116834 service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-unplugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Instance destroyed successfully.
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'resources' on Instance uuid 1a31fa46-141c-4685-9c9b-abf78eb549f9 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:00:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1643861038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1643861038',id=33,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-lv0x5x23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:05:09Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=1a31fa46-141c-4685-9c9b-abf78eb549f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "add2e353-4f48-4a42-8eee-955da3ff6b11", "address": "fa:16:3e:a3:74:97", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd2e353-4f", "ovs_interfaceid": "add2e353-4f48-4a42-8eee-955da3ff6b11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_vif [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd2e353-4f, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98f86a9c-fa94-4fbf-b020-3b1e00e5dd28) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:38 user nova-compute[74441]: INFO os_vif [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:74:97,bridge_name='br-int',has_traffic_filtering=True,id=add2e353-4f48-4a42-8eee-955da3ff6b11,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd2e353-4f')
Nov 09 01:11:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJFOLzBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:11:38 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c07fbbf-3233-485f-91ca-264f3c98ff91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:11:38 user nova-compute[74441]: No targets found.
Nov 09 01:11:38 user nova-compute[74441]: iSNS:
Nov 09 01:11:38 user nova-compute[74441]: No targets found.
Nov 09 01:11:38 user nova-compute[74441]: STATIC:
Nov 09 01:11:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087
Nov 09 01:11:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:11:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:11:38 user nova-compute[74441]: FIRMWARE:
Nov 09 01:11:38 user nova-compute[74441]: No targets found.
Nov 09 01:11:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:11:38 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:11:38 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d03135-31df-4ffe-94d1-9e41a05e8f1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8953790-ea7b-4434-84ba-0c3a5244f5e7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:11:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 (non-flash)
Nov 09 01:11:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c2d92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7d332c-d952-4de3-ae3d-9dc35ea7ed51]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[979fb67d-03d5-409c-a3e0-95beeddcfa8f]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:11:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cd4e5e-c843-4246-a2be-571f7520916d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[510dc105-a80f-426b-97e3-062c72cd5934]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866caf2-d49b-4040-9a6c-4bdceb267149]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c35c6ca-7e42-44d6-a585-7e02e7bbabd5]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260]
Nov 09 01:11:39 user nova-compute[74441]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087, portal: 172.16.0.220,3260] successful.
Nov 09 01:11:39 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2fed908-bbff-4c17-ad25-5b69d384b087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a6f46-64c6-4475-aa82-4f8acd568ce1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] <== disconnect_volume: return (304ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:11:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Deleting instance files /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9_del
Nov 09 01:11:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Deletion of /opt/stack/data/nova/instances/1a31fa46-141c-4685-9c9b-abf78eb549f9_del complete
Nov 09 01:11:39 user nova-compute[74441]: INFO nova.compute.manager [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 09 01:11:39 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:11:39 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:11:39 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Took 0.46 seconds to deallocate network for instance.
Nov 09 01:11:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] Acquiring lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] No waiting events found dispatching network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:11:40 user nova-compute[74441]: WARNING nova.compute.manager [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received unexpected event network-vif-plugged-add2e353-4f48-4a42-8eee-955da3ff6b11 for instance with vm_state active and task_state deleting.
Nov 09 01:11:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-3e5a3709-67bc-41a2-9f96-f9b38780373c req-27fa9a0e-8caa-4a5c-a5f5-6317699e836d service nova] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Received event network-vif-deleted-add2e353-4f48-4a42-8eee-955da3ff6b11 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:11:40 user nova-compute[74441]: INFO nova.compute.manager [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 1a31fa46-141c-4685-9c9b-abf78eb549f9] Took 1.03 seconds to detach 1 volumes for instance.
Nov 09 01:11:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:11:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:11:40 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:11:41 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:11:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:41 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Deleted allocations for instance 1a31fa46-141c-4685-9c9b-abf78eb549f9
Nov 09 01:11:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9f96fd81-8ac2-47cc-8aea-ef1769b63a50 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "1a31fa46-141c-4685-9c9b-abf78eb549f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.097s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:11:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:11:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:11:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:11:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:11:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:11:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:03 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:12:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:12:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:12:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:12:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:12:18 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:12:18 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:12:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8476MB free_disk=24.886112213134766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d64a477e-66b2-48b9-886d-ca146148167a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:12:18 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:12:19 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:12:19 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:12:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:12:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:28 user nova-compute[74441]: INFO nova.compute.manager [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Terminating instance
Nov 09 01:12:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-47cec078-4e3b-47bc-8273-fa9eb0644470 req-b195ab74-ec8e-425b-b960-6b4172ccdc8d service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-vif-unplugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-47cec078-4e3b-47bc-8273-fa9eb0644470 req-b195ab74-ec8e-425b-b960-6b4172ccdc8d service nova] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-47cec078-4e3b-47bc-8273-fa9eb0644470 req-b195ab74-ec8e-425b-b960-6b4172ccdc8d service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-47cec078-4e3b-47bc-8273-fa9eb0644470 req-b195ab74-ec8e-425b-b960-6b4172ccdc8d service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-47cec078-4e3b-47bc-8273-fa9eb0644470 req-b195ab74-ec8e-425b-b960-6b4172ccdc8d service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] No waiting events found dispatching network-vif-unplugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.compute.manager [req-47cec078-4e3b-47bc-8273-fa9eb0644470 req-b195ab74-ec8e-425b-b960-6b4172ccdc8d service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-vif-unplugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:12:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Instance destroyed successfully.
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.objects.instance [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lazy-loading 'resources' on Instance uuid 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T00:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-678253497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-678253497',id=28,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T00:57:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaf77bd26a3e4bb1831823704242a3b6',ramdisk_id='',reservation_id='r-s84tfk2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T00:59:30Z,user_data=None,user_id='ffa1084de0be460fa924e3f124e47a21',uuid=3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converting VIF {"id": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "address": "fa:16:3e:7b:34:c4", "network": {"id": "933fddd8-00a0-4bfc-9777-1ae5e23a2801", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-474757267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaf77bd26a3e4bb1831823704242a3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d382fe-7c", "ovs_interfaceid": "32d382fe-7c96-4600-a1bc-34096d65f3c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG os_vif [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32d382fe-7c, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73f19caa-1944-4b10-9a55-25d7be685ffd) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:12:29 user nova-compute[74441]: INFO os_vif [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:34:c4,bridge_name='br-int',has_traffic_filtering=True,id=32d382fe-7c96-4600-a1bc-34096d65f3c6,network=Network(933fddd8-00a0-4bfc-9777-1ae5e23a2801),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d382fe-7c')
Nov 09 01:12:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Deleting instance files /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd_del
Nov 09 01:12:29 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Deletion of /opt/stack/data/nova/instances/3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd_del complete
Nov 09 01:12:29 user nova-compute[74441]: INFO nova.compute.manager [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 01:12:29 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:12:29 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:12:30 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:12:30 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Took 1.03 seconds to deallocate network for instance.
Nov 09 01:12:30 user nova-compute[74441]: DEBUG nova.compute.manager [req-9fdc81ba-3480-4179-80a5-332064c5fb42 req-02d375e1-c41a-421b-afa9-7d47c0d63926 service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-vif-deleted-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:12:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:31 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Deleted allocations for instance 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd
Nov 09 01:12:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-297e21be-d8a2-4d5d-95dd-3c51d6e542a7 tempest-ServerBootFromVolumeStableRescueTest-1850620491 tempest-ServerBootFromVolumeStableRescueTest-1850620491-project-member] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.291s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-3094eae0-a365-417e-bd6a-5254c0759cdb req-a7116981-32ae-4045-a100-d37b7fa354cc service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received event network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3094eae0-a365-417e-bd6a-5254c0759cdb req-a7116981-32ae-4045-a100-d37b7fa354cc service nova] Acquiring lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3094eae0-a365-417e-bd6a-5254c0759cdb req-a7116981-32ae-4045-a100-d37b7fa354cc service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3094eae0-a365-417e-bd6a-5254c0759cdb req-a7116981-32ae-4045-a100-d37b7fa354cc service nova] Lock "3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:12:31 user nova-compute[74441]: DEBUG nova.compute.manager [req-3094eae0-a365-417e-bd6a-5254c0759cdb req-a7116981-32ae-4045-a100-d37b7fa354cc service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] No waiting events found dispatching network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:12:31 user nova-compute[74441]: WARNING nova.compute.manager [req-3094eae0-a365-417e-bd6a-5254c0759cdb req-a7116981-32ae-4045-a100-d37b7fa354cc service nova] [instance: 3fe8f7f1-5a42-4ce0-be58-5bab807bc6dd] Received unexpected event network-vif-plugged-32d382fe-7c96-4600-a1bc-34096d65f3c6 for instance with vm_state deleted and task_state None.
Nov 09 01:12:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:12:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:13:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:01 user nova-compute[74441]: INFO nova.compute.manager [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Terminating instance
Nov 09 01:13:01 user nova-compute[74441]: DEBUG nova.compute.manager [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:13:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6a4e1b8-7043-44c0-96dd-88a0598ea253 req-e76ff24c-c14d-4966-8c88-c497832a6e6a service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6a4e1b8-7043-44c0-96dd-88a0598ea253 req-e76ff24c-c14d-4966-8c88-c497832a6e6a service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6a4e1b8-7043-44c0-96dd-88a0598ea253 req-e76ff24c-c14d-4966-8c88-c497832a6e6a service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6a4e1b8-7043-44c0-96dd-88a0598ea253 req-e76ff24c-c14d-4966-8c88-c497832a6e6a service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6a4e1b8-7043-44c0-96dd-88a0598ea253 req-e76ff24c-c14d-4966-8c88-c497832a6e6a service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6a4e1b8-7043-44c0-96dd-88a0598ea253 req-e76ff24c-c14d-4966-8c88-c497832a6e6a service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-unplugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:13:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Instance destroyed successfully.
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'resources' on Instance uuid d64a477e-66b2-48b9-886d-ca146148167a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1798271286',display_name='tempest-AttachVolumeTestJSON-server-1798271286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1798271286',id=37,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK0+Q3OTxQv+XsugKQp9QdZCMPINMAZm1liuNDt34zH7KOpfS4L21mdj6xU6UAa2dy6VoP0nIUfjlsAHfmkoV3LVGguP/7twmQRWtHMjQ3mh+Prs0GvB1xUY9DoXnaskA==',key_name='tempest-keypair-693541620',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-tunicqrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=d64a477e-66b2-48b9-886d-ca146148167a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "address": "fa:16:3e:d7:35:97", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65db9fd8-e6", "ovs_interfaceid": "65db9fd8-e6f2-41f5-9bcc-e52d93471f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG os_vif [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65db9fd8-e6, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15e8bc0b-537f-4c2a-b4f9-a62b075ff57a) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:13:02 user nova-compute[74441]: INFO os_vif [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:97,bridge_name='br-int',has_traffic_filtering=True,id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65db9fd8-e6')
Nov 09 01:13:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Deleting instance files /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a_del
Nov 09 01:13:02 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Deletion of /opt/stack/data/nova/instances/d64a477e-66b2-48b9-886d-ca146148167a_del complete
Nov 09 01:13:02 user nova-compute[74441]: INFO nova.compute.manager [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 09 01:13:02 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:13:02 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:13:03 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Took 0.96 seconds to deallocate network for instance.
Nov 09 01:13:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-c9c30b26-681c-4dff-a569-882a7a95ccac req-9a1dcf8c-fd06-41d8-af0e-696958973905 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-deleted-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:13:03 user nova-compute[74441]: INFO nova.compute.manager [req-c9c30b26-681c-4dff-a569-882a7a95ccac req-9a1dcf8c-fd06-41d8-af0e-696958973905 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Neutron deleted interface 65db9fd8-e6f2-41f5-9bcc-e52d93471f61; detaching it from the instance and deleting it from the info cache
Nov 09 01:13:03 user nova-compute[74441]: DEBUG nova.network.neutron [req-c9c30b26-681c-4dff-a569-882a7a95ccac req-9a1dcf8c-fd06-41d8-af0e-696958973905 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-c9c30b26-681c-4dff-a569-882a7a95ccac req-9a1dcf8c-fd06-41d8-af0e-696958973905 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Detach interface failed, port_id=65db9fd8-e6f2-41f5-9bcc-e52d93471f61, reason: Instance d64a477e-66b2-48b9-886d-ca146148167a could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:13:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:03 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Deleted allocations for instance d64a477e-66b2-48b9-886d-ca146148167a
Nov 09 01:13:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ceb00a51-3745-4cee-8855-4a21898d69fc tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "d64a477e-66b2-48b9-886d-ca146148167a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.objects.instance [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'flavor' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] Acquiring lock "d64a477e-66b2-48b9-886d-ca146148167a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] Lock "d64a477e-66b2-48b9-886d-ca146148167a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] No waiting events found dispatching network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:13:04 user nova-compute[74441]: WARNING nova.compute.manager [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: d64a477e-66b2-48b9-886d-ca146148167a] Received unexpected event network-vif-plugged-65db9fd8-e6f2-41f5-9bcc-e52d93471f61 for instance with vm_state deleted and task_state None.
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-changed-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Refreshing instance network info cache due to event network-changed-96af8899-9fcd-4ad9-ac8d-f08f81e85f93. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.network.neutron [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Refreshing network info cache for port 96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:04 user nova-compute[74441]: INFO nova.compute.manager [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Attaching volume 396bc57c-9035-431f-af8b-98f2e4d6a254 to /dev/vdb
Nov 09 01:13:04 user nova-compute[74441]: DEBUG os_brick.utils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105c8c7-94ab-4fcc-ad60-12532a4eb6bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[01369f0e-47b8-4b1e-bd17-e6462a416ece]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ae13e-3351-41da-ad65-7f2a7e86128f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd13b8-dba1-46c5-b699-e3251f93946f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:13:04 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca78e381-da78-4a5e-a43c-fec0f1ac4595]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG os_brick.utils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating existing volume attachment record: 37128187-33e9-4d23-a730-a3f6ab6ebca5 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.network.neutron [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updated VIF entry in instance network info cache for port 96af8899-9fcd-4ad9-ac8d-f08f81e85f93. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG nova.network.neutron [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:13:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a57507cc-62fe-4784-a625-41dec739d658 req-786f6be0-1744-4f40-922d-ac5fd0196fb4 service nova] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:13:05 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:13:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:13:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:20 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:13:20 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=25.027179718017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:13:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:28 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:13:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTokrFSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:13:28 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:13:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:13:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:13:28 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:13:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:13:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:13:29 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77c8d91-357f-40a3-9c3f-cbccb5324eb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:13:29 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df8f16-f11a-438c-9fe2-1dafc2199bf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254] added
Nov 09 01:13:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7a56d3-99cf-4342-b581-05ec1c8e05ce]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d309d6-c8f2-4e05-af8a-b774169fe98d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTokrFSj {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTokrFSj" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a4fc2-0813-4e2a-8ca7-2f4dc86ba901]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTokrFSj'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdddb8da-bf03-4559-98cb-3f71a7e6ff69]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e44005-4e0c-4cf0-ae3b-66bca4b4310b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 01:13:29 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 01:13:29 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:13:29 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 01:13:29 user nova-compute[74441]: 
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7a1607-8257-4459-b077-dd2a55b371c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260]
Nov 09 01:13:29 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260] successful.
Nov 09 01:13:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6602b2-9ddf-454c-8b3d-723120326463]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0415ee53-5fe3-44d0-9e66-806fce584c83]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 (non-flash)
Nov 09 01:13:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 (non-flash)
Nov 09 01:13:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a92c4f-3c6c-42bf-865c-3c2f04b2a2e5]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:29 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTokrFSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23833323164613462', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833323164613462', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG nova.objects.instance [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'flavor' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:13:30 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:13:30 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:13:30 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:13:30 user nova-compute[74441]:   <serial>396bc57c-9035-431f-af8b-98f2e4d6a254</serial>
Nov 09 01:13:30 user nova-compute[74441]: </disk>
Nov 09 01:13:30 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No VIF found with MAC fa:16:3e:a2:33:2c, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:13:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-7653e55f-4d1e-47ec-8289-1b3231c19a6b tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.462s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:13:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:32 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:32 user nova-compute[74441]: INFO nova.compute.manager [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Detaching volume 396bc57c-9035-431f-af8b-98f2e4d6a254
Nov 09 01:13:33 user nova-compute[74441]: INFO nova.virt.block_device [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Attempting to driver detach volume 396bc57c-9035-431f-af8b-98f2e4d6a254 from mountpoint /dev/vdb
Nov 09 01:13:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Attempting to detach device vdb from instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:13:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:13:33 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:13:33 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:13:33 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:13:33 user nova-compute[74441]:   <serial>396bc57c-9035-431f-af8b-98f2e4d6a254</serial>
Nov 09 01:13:33 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:13:33 user nova-compute[74441]: </disk>
Nov 09 01:13:33 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:13:33 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully detached device vdb from instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 from the persistent domain config.
Nov 09 01:13:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:13:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:13:33 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:13:33 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:13:33 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:13:33 user nova-compute[74441]:   <serial>396bc57c-9035-431f-af8b-98f2e4d6a254</serial>
Nov 09 01:13:33 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:13:33 user nova-compute[74441]: </disk>
Nov 09 01:13:33 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:13:33 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:13:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Verify base images {{(pid=74441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Image id 8bb75127-e2cb-4fc7-b1f7-8e01f3707323 yields fingerprint 77726613366e27f1d9da7a0cca2ca3d139158fa4 {{(pid=74441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] image 8bb75127-e2cb-4fc7-b1f7-8e01f3707323 at (/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4): checking
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] image 8bb75127-e2cb-4fc7-b1f7-8e01f3707323 at (/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4): image is in use {{(pid=74441) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] 0558985f-65a5-49b7-8f2f-147dd3b029b8 is a valid instance name {{(pid=74441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] 0558985f-65a5-49b7-8f2f-147dd3b029b8 has a disk file {{(pid=74441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 is backed by 77726613366e27f1d9da7a0cca2ca3d139158fa4 {{(pid=74441) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048
Nov 09 01:13:41 user nova-compute[74441]: WARNING nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Active base files: /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Removable base files: /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8 /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61 /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048 /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1d17c2596d9a1d6c69655a556db1e73afeeec7d8
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8e6bf2c8ea965eab4c68bbe927c949b5d7eb8f2b
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4dd66ce250ee13a6c422daf973cb8b4da619aa61
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf8769eb1bfb3e6d46244e6a53af9dc93555d16e
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b08c2ba132b05e6c108017936a22b4bf85a593b
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ae004f3af2a190f9055f550d1d146714a0425048
Nov 09 01:13:41 user nova-compute[74441]: INFO nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbc45390b1b102250da703e93a0341e739503f3a
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Verification complete {{(pid=74441) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Verify swap images {{(pid=74441) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 09 01:13:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.imagecache [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Verify ephemeral images {{(pid=74441) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 09 01:13:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:53 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 is timed out.
Nov 09 01:13:53 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully detached device vdb from instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 from the live domain config.
Nov 09 01:13:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTokrFSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:13:53 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[73adb6af-467f-4920-91b1-ff07f87737d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:13:53 user nova-compute[74441]: No targets found.
Nov 09 01:13:53 user nova-compute[74441]: iSNS:
Nov 09 01:13:53 user nova-compute[74441]: No targets found.
Nov 09 01:13:53 user nova-compute[74441]: STATIC:
Nov 09 01:13:53 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254
Nov 09 01:13:53 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:13:53 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:13:53 user nova-compute[74441]: FIRMWARE:
Nov 09 01:13:53 user nova-compute[74441]: No targets found.
Nov 09 01:13:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:13:53 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:13:53 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf250555-aaa9-4484-adb9-069a3a689303]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff22176-f11f-425e-a669-350cf269b8bd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 (non-flash)
Nov 09 01:13:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 (non-flash)
Nov 09 01:13:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c53aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee8acb6-8f54-4bef-8bbc-8eec55d14c53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d26b144-8954-4bb4-a087-86e0d371fc33]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f8993b-8e12-44f8-9bf1-5e2e76c18be7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dac22a-ba14-41f0-8f71-0e10716ab51c]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbea88-c798-4c52-808f-2140736c134a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[93edcbf3-9e02-47e2-b018-e83900b75a25]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260]
Nov 09 01:13:53 user nova-compute[74441]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254, portal: 172.16.0.220,3260] successful.
Nov 09 01:13:53 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:396bc57c-9035-431f-af8b-98f2e4d6a254 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146da05-3637-45f5-b27b-fed6cd1ab42c]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] <== disconnect_volume: return (346ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:13:53 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:13:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'flavor' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:13:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-51e55195-f0ce-4815-b223-dfc9a929cc4c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.241s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:56 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:56 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:13:57 user nova-compute[74441]: INFO nova.compute.claims [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Claim successful on node user
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:13:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.policy [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d6713a112a64d03a7cd67c304a85ddd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aa9979e78d4597ae023610b56f5a60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:13:57 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Creating image(s)
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "/opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "/opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.234s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:57 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk 1073741824" returned: 0 in 0.066s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Successfully created port: dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Cannot resize image /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Ensure instance console log exists: /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:13:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Successfully updated port: dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquired lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-changed-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Refreshing instance network info cache due to event network-changed-dfb1522a-a9f7-4307-aa00-6466121817ec. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] Acquiring lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Releasing lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Instance network_info: |[{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] Acquired lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.neutron [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Refreshing network info cache for port dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Start _get_guest_xml network_info=[{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:13:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:13:59 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1945739091',display_name='tempest-AttachVolumeTestJSON-server-1945739091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1945739091',id=45,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1lCe5XGCfGBKthWcS8OrZL5pZCw/A6TXNmIPbf8IQLhJApDalYRnIx+PgnJffJKbipBZplwpTHOJivcOssWlHqBjkbjUPPf7zYDemb2H215EfeNavIe4KeVoGBGQBNLw==',key_name='tempest-keypair-1605616455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-vemabhvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=6a246a92-0eb4-4065-b4d2-d3b8b15f3f54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:13:59 user nova-compute[74441]:   <uuid>6a246a92-0eb4-4065-b4d2-d3b8b15f3f54</uuid>
Nov 09 01:13:59 user nova-compute[74441]:   <name>instance-0000002d</name>
Nov 09 01:13:59 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:13:59 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:13:59 user nova-compute[74441]:   <metadata>
Nov 09 01:13:59 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:13:59 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:13:59 user nova-compute[74441]:       <nova:name>tempest-AttachVolumeTestJSON-server-1945739091</nova:name>
Nov 09 01:13:59 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:13:59</nova:creationTime>
Nov 09 01:13:59 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:13:59 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:13:59 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:13:59 user nova-compute[74441]:       <nova:owner>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:user uuid="9d6713a112a64d03a7cd67c304a85ddd">tempest-AttachVolumeTestJSON-1454008029-project-member</nova:user>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:project uuid="01aa9979e78d4597ae023610b56f5a60">tempest-AttachVolumeTestJSON-1454008029</nova:project>
Nov 09 01:13:59 user nova-compute[74441]:       </nova:owner>
Nov 09 01:13:59 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:13:59 user nova-compute[74441]:       <nova:ports>
Nov 09 01:13:59 user nova-compute[74441]:         <nova:port uuid="dfb1522a-a9f7-4307-aa00-6466121817ec">
Nov 09 01:13:59 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 01:13:59 user nova-compute[74441]:         </nova:port>
Nov 09 01:13:59 user nova-compute[74441]:       </nova:ports>
Nov 09 01:13:59 user nova-compute[74441]:     </nova:instance>
Nov 09 01:13:59 user nova-compute[74441]:   </metadata>
Nov 09 01:13:59 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:13:59 user nova-compute[74441]:     <system>
Nov 09 01:13:59 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:13:59 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:13:59 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:13:59 user nova-compute[74441]:       <entry name="serial">6a246a92-0eb4-4065-b4d2-d3b8b15f3f54</entry>
Nov 09 01:13:59 user nova-compute[74441]:       <entry name="uuid">6a246a92-0eb4-4065-b4d2-d3b8b15f3f54</entry>
Nov 09 01:13:59 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:13:59 user nova-compute[74441]:     </system>
Nov 09 01:13:59 user nova-compute[74441]:   </sysinfo>
Nov 09 01:13:59 user nova-compute[74441]:   <os>
Nov 09 01:13:59 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:13:59 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:13:59 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:13:59 user nova-compute[74441]:   </os>
Nov 09 01:13:59 user nova-compute[74441]:   <features>
Nov 09 01:13:59 user nova-compute[74441]:     <acpi/>
Nov 09 01:13:59 user nova-compute[74441]:     <apic/>
Nov 09 01:13:59 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:13:59 user nova-compute[74441]:   </features>
Nov 09 01:13:59 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:13:59 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:13:59 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:13:59 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:13:59 user nova-compute[74441]:   </clock>
Nov 09 01:13:59 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:13:59 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:13:59 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:13:59 user nova-compute[74441]:   </cpu>
Nov 09 01:13:59 user nova-compute[74441]:   <devices>
Nov 09 01:13:59 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:13:59 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:13:59 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk"/>
Nov 09 01:13:59 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:13:59 user nova-compute[74441]:     </disk>
Nov 09 01:13:59 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:13:59 user nova-compute[74441]:       <mac address="fa:16:3e:d3:dc:d3"/>
Nov 09 01:13:59 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:13:59 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:13:59 user nova-compute[74441]:       <target dev="tapdfb1522a-a9"/>
Nov 09 01:13:59 user nova-compute[74441]:     </interface>
Nov 09 01:13:59 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:13:59 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/console.log" append="off"/>
Nov 09 01:13:59 user nova-compute[74441]:     </serial>
Nov 09 01:13:59 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:13:59 user nova-compute[74441]:     <video>
Nov 09 01:13:59 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:13:59 user nova-compute[74441]:     </video>
Nov 09 01:13:59 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:13:59 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:13:59 user nova-compute[74441]:     </rng>
Nov 09 01:13:59 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:13:59 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:13:59 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:13:59 user nova-compute[74441]:     </memballoon>
Nov 09 01:13:59 user nova-compute[74441]:   </devices>
Nov 09 01:13:59 user nova-compute[74441]: </domain>
Nov 09 01:13:59 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1945739091',display_name='tempest-AttachVolumeTestJSON-server-1945739091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1945739091',id=45,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1lCe5XGCfGBKthWcS8OrZL5pZCw/A6TXNmIPbf8IQLhJApDalYRnIx+PgnJffJKbipBZplwpTHOJivcOssWlHqBjkbjUPPf7zYDemb2H215EfeNavIe4KeVoGBGQBNLw==',key_name='tempest-keypair-1605616455',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-vemabhvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=6a246a92-0eb4-4065-b4d2-d3b8b15f3f54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG os_vif [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfcb70fd-c1ce-5d38-9415-fbdc1ece3030', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfb1522a-a9, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfb1522a-a9, col_values=(('qos', UUID('5101b783-4590-4009-831d-44ebd5109059')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfb1522a-a9, col_values=(('external_ids', {'iface-id': 'dfb1522a-a9f7-4307-aa00-6466121817ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:dc:d3', 'vm-uuid': '6a246a92-0eb4-4065-b4d2-d3b8b15f3f54'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:13:59 user nova-compute[74441]: INFO os_vif [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9')
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:13:59 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No VIF found with MAC fa:16:3e:d3:dc:d3, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:14:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updated VIF entry in instance network info cache for port dfb1522a-a9f7-4307-aa00-6466121817ec. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:14:00 user nova-compute[74441]: DEBUG nova.network.neutron [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:14:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-71e20ef2-0d36-4f4f-a937-65ff13df5499 req-359e4d82-5be6-4958-a450-2809fb335bfc service nova] Releasing lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-16d911c0-3d8e-420b-822c-e82edec54950 req-c99acb9e-5b89-4843-afb0-514ad56c0bde service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16d911c0-3d8e-420b-822c-e82edec54950 req-c99acb9e-5b89-4843-afb0-514ad56c0bde service nova] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16d911c0-3d8e-420b-822c-e82edec54950 req-c99acb9e-5b89-4843-afb0-514ad56c0bde service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-16d911c0-3d8e-420b-822c-e82edec54950 req-c99acb9e-5b89-4843-afb0-514ad56c0bde service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG nova.compute.manager [req-16d911c0-3d8e-420b-822c-e82edec54950 req-c99acb9e-5b89-4843-afb0-514ad56c0bde service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] No waiting events found dispatching network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:14:01 user nova-compute[74441]: WARNING nova.compute.manager [req-16d911c0-3d8e-420b-822c-e82edec54950 req-c99acb9e-5b89-4843-afb0-514ad56c0bde service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received unexpected event network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec for instance with vm_state building and task_state spawning.
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:14:03 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Instance spawned successfully.
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3fac75b-0580-4c54-b23f-a9cab2c54667 req-fe6f941f-ab73-4054-8daf-d3d8a1c5adb8 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3fac75b-0580-4c54-b23f-a9cab2c54667 req-fe6f941f-ab73-4054-8daf-d3d8a1c5adb8 service nova] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3fac75b-0580-4c54-b23f-a9cab2c54667 req-fe6f941f-ab73-4054-8daf-d3d8a1c5adb8 service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-f3fac75b-0580-4c54-b23f-a9cab2c54667 req-fe6f941f-ab73-4054-8daf-d3d8a1c5adb8 service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.compute.manager [req-f3fac75b-0580-4c54-b23f-a9cab2c54667 req-fe6f941f-ab73-4054-8daf-d3d8a1c5adb8 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] No waiting events found dispatching network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:14:03 user nova-compute[74441]: WARNING nova.compute.manager [req-f3fac75b-0580-4c54-b23f-a9cab2c54667 req-fe6f941f-ab73-4054-8daf-d3d8a1c5adb8 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received unexpected event network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec for instance with vm_state building and task_state spawning.
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:03 user nova-compute[74441]: INFO nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 09 01:14:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:14:03 user nova-compute[74441]: INFO nova.compute.manager [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Took 6.57 seconds to build instance.
Nov 09 01:14:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e4041d92-26ee-443a-af81-1f89865ab8a7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.690s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:14:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:14:07 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:14:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:14:07 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:14:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:14:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:14:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:14:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:14:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:14:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 01:14:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:22 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:14:22 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=24.99549102783203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:14:22 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 01:14:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:14:36 user nova-compute[74441]: INFO nova.compute.manager [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] instance snapshotting
Nov 09 01:14:36 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Beginning live snapshot process
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json -f qcow2 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj0bz29g_/63d63671ae40431f8634bed74dddb8a1.delta 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj0bz29g_/63d63671ae40431f8634bed74dddb8a1.delta 1073741824" returned: 0 in 0.052s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 01:14:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 01:14:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] COPY block job progress, current cursor: 14942208 final cursor: 75563008 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 01:14:39 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74441) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 01:14:39 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 01:14:39 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 01:14:39 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj0bz29g_/63d63671ae40431f8634bed74dddb8a1.delta /opt/stack/data/nova/instances/snapshots/tmpj0bz29g_/63d63671ae40431f8634bed74dddb8a1 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:14:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj0bz29g_/63d63671ae40431f8634bed74dddb8a1.delta /opt/stack/data/nova/instances/snapshots/tmpj0bz29g_/63d63671ae40431f8634bed74dddb8a1" returned: 0 in 0.589s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:40 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Snapshot extracted, beginning image upload
Nov 09 01:14:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Snapshot image upload complete
Nov 09 01:14:42 user nova-compute[74441]: INFO nova.compute.manager [None req-570f7827-60c6-4c5b-85ac-0a220605228c tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Took 5.85 seconds to snapshot the instance on the hypervisor.
Nov 09 01:14:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:14:44 user nova-compute[74441]: INFO nova.compute.claims [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Claim successful on node user
Nov 09 01:14:44 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:44 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG nova.network.neutron [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:14:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:14:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG nova.policy [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96586584970e41a7be230fa812eee595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8cfa05f08e4a99adff754a174b6e42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:14:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Creating image(s)
Nov 09 01:14:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "/opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "/opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "/opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "85ee724bf0147ec9edea8720e755ebdc16e7b294" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "85ee724bf0147ec9edea8720e755ebdc16e7b294" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.part --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Successfully created port: 33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.virt.images [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] 415afbc4-3c6e-4151-96cc-3a8af09c2a0f was qcow2, converting to raw {{(pid=74441) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.privsep.utils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74441) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.part /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.converted {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.part /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.converted" returned: 0 in 0.256s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.converted --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "85ee724bf0147ec9edea8720e755ebdc16e7b294" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.525s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Successfully updated port: 33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquired lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-changed-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG nova.compute.manager [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Refreshing instance network info cache due to event network-changed-33b42049-0332-4a2a-b067-d3e715b8188c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] Acquiring lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294 --force-share --output=json" returned: 0 in 0.219s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "85ee724bf0147ec9edea8720e755ebdc16e7b294" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "85ee724bf0147ec9edea8720e755ebdc16e7b294" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:46 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294 --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294,backing_fmt=raw /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294,backing_fmt=raw /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk 1073741824" returned: 0 in 0.123s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "85ee724bf0147ec9edea8720e755ebdc16e7b294" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85ee724bf0147ec9edea8720e755ebdc16e7b294 --force-share --output=json" returned: 0 in 0.170s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Ensure instance console log exists: /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating instance_info_cache with network_info: [{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Releasing lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Instance network_info: |[{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] Acquired lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.neutron [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Refreshing network info cache for port 33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Start _get_guest_xml network_info=[{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='15550fc664bd300101052d3149dbdae7',container_format='bare',created_at=2023-11-09T01:14:37Z,direct_url=<?>,disk_format='qcow2',id=415afbc4-3c6e-4151-96cc-3a8af09c2a0f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2114982505',owner='2c8cfa05f08e4a99adff754a174b6e42',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T01:14:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '415afbc4-3c6e-4151-96cc-3a8af09c2a0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:14:47 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:14:47 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='15550fc664bd300101052d3149dbdae7',container_format='bare',created_at=2023-11-09T01:14:37Z,direct_url=<?>,disk_format='qcow2',id=415afbc4-3c6e-4151-96cc-3a8af09c2a0f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2114982505',owner='2c8cfa05f08e4a99adff754a174b6e42',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T01:14:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2097377907',display_name='tempest-TestStampPattern-server-2097377907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2097377907',id=46,image_ref='415afbc4-3c6e-4151-96cc-3a8af09c2a0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo7/pO4zSR1ADroCCg2eqYQ9pbvdCL5YyDK/eyYN9sApBRkwrLnAHtd5EEOhoWcsdQ5yZW+/68PtpdGs1Y/XPdTufNmckviqD07G4Xfbq1cpMUUyQzuCUmFoGCYG99Qng==',key_name='tempest-TestStampPattern-181357963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8cfa05f08e4a99adff754a174b6e42',ramdisk_id='',reservation_id='r-08pr4478',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0558985f-65a5-49b7-8f2f-147dd3b029b8',image_min_disk='1',image_min_ram='0',image_owner_id='2c8cfa05f08e4a99adff754a174b6e42',image_owner_project_name='tempest-TestStampPattern-1784819717',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1784819717-project-member',image_user_id='96586584970e41a7be230fa812eee595',network_allocated='True',owner_project_name='tempest-TestStampPattern-1784819717',owner_user_name='tempest-TestStampPattern-1784819717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:14:45Z,user_data=None,user_id='96586584970e41a7be230fa812eee595',uuid=0138f302-8a57-4060-b476-ff1d673fa02a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converting VIF {"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.objects.instance [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'pci_devices' on Instance uuid 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:14:47 user nova-compute[74441]:   <uuid>0138f302-8a57-4060-b476-ff1d673fa02a</uuid>
Nov 09 01:14:47 user nova-compute[74441]:   <name>instance-0000002e</name>
Nov 09 01:14:47 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:14:47 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:14:47 user nova-compute[74441]:   <metadata>
Nov 09 01:14:47 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:14:47 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:14:47 user nova-compute[74441]:       <nova:name>tempest-TestStampPattern-server-2097377907</nova:name>
Nov 09 01:14:47 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:14:47</nova:creationTime>
Nov 09 01:14:47 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:14:47 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:14:47 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:14:47 user nova-compute[74441]:       <nova:owner>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:user uuid="96586584970e41a7be230fa812eee595">tempest-TestStampPattern-1784819717-project-member</nova:user>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:project uuid="2c8cfa05f08e4a99adff754a174b6e42">tempest-TestStampPattern-1784819717</nova:project>
Nov 09 01:14:47 user nova-compute[74441]:       </nova:owner>
Nov 09 01:14:47 user nova-compute[74441]:       <nova:root type="image" uuid="415afbc4-3c6e-4151-96cc-3a8af09c2a0f"/>
Nov 09 01:14:47 user nova-compute[74441]:       <nova:ports>
Nov 09 01:14:47 user nova-compute[74441]:         <nova:port uuid="33b42049-0332-4a2a-b067-d3e715b8188c">
Nov 09 01:14:47 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 01:14:47 user nova-compute[74441]:         </nova:port>
Nov 09 01:14:47 user nova-compute[74441]:       </nova:ports>
Nov 09 01:14:47 user nova-compute[74441]:     </nova:instance>
Nov 09 01:14:47 user nova-compute[74441]:   </metadata>
Nov 09 01:14:47 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:14:47 user nova-compute[74441]:     <system>
Nov 09 01:14:47 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:14:47 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:14:47 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:14:47 user nova-compute[74441]:       <entry name="serial">0138f302-8a57-4060-b476-ff1d673fa02a</entry>
Nov 09 01:14:47 user nova-compute[74441]:       <entry name="uuid">0138f302-8a57-4060-b476-ff1d673fa02a</entry>
Nov 09 01:14:47 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:14:47 user nova-compute[74441]:     </system>
Nov 09 01:14:47 user nova-compute[74441]:   </sysinfo>
Nov 09 01:14:47 user nova-compute[74441]:   <os>
Nov 09 01:14:47 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:14:47 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:14:47 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:14:47 user nova-compute[74441]:   </os>
Nov 09 01:14:47 user nova-compute[74441]:   <features>
Nov 09 01:14:47 user nova-compute[74441]:     <acpi/>
Nov 09 01:14:47 user nova-compute[74441]:     <apic/>
Nov 09 01:14:47 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:14:47 user nova-compute[74441]:   </features>
Nov 09 01:14:47 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:14:47 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:14:47 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:14:47 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:14:47 user nova-compute[74441]:   </clock>
Nov 09 01:14:47 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:14:47 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:14:47 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:14:47 user nova-compute[74441]:   </cpu>
Nov 09 01:14:47 user nova-compute[74441]:   <devices>
Nov 09 01:14:47 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:14:47 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:14:47 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk"/>
Nov 09 01:14:47 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:14:47 user nova-compute[74441]:     </disk>
Nov 09 01:14:47 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:14:47 user nova-compute[74441]:       <mac address="fa:16:3e:e3:da:c5"/>
Nov 09 01:14:47 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:14:47 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:14:47 user nova-compute[74441]:       <target dev="tap33b42049-03"/>
Nov 09 01:14:47 user nova-compute[74441]:     </interface>
Nov 09 01:14:47 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:14:47 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/console.log" append="off"/>
Nov 09 01:14:47 user nova-compute[74441]:     </serial>
Nov 09 01:14:47 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:14:47 user nova-compute[74441]:     <video>
Nov 09 01:14:47 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:14:47 user nova-compute[74441]:     </video>
Nov 09 01:14:47 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:14:47 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:14:47 user nova-compute[74441]:     </rng>
Nov 09 01:14:47 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:14:47 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:14:47 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:14:47 user nova-compute[74441]:     </memballoon>
Nov 09 01:14:47 user nova-compute[74441]:   </devices>
Nov 09 01:14:47 user nova-compute[74441]: </domain>
Nov 09 01:14:47 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2097377907',display_name='tempest-TestStampPattern-server-2097377907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2097377907',id=46,image_ref='415afbc4-3c6e-4151-96cc-3a8af09c2a0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo7/pO4zSR1ADroCCg2eqYQ9pbvdCL5YyDK/eyYN9sApBRkwrLnAHtd5EEOhoWcsdQ5yZW+/68PtpdGs1Y/XPdTufNmckviqD07G4Xfbq1cpMUUyQzuCUmFoGCYG99Qng==',key_name='tempest-TestStampPattern-181357963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8cfa05f08e4a99adff754a174b6e42',ramdisk_id='',reservation_id='r-08pr4478',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0558985f-65a5-49b7-8f2f-147dd3b029b8',image_min_disk='1',image_min_ram='0',image_owner_id='2c8cfa05f08e4a99adff754a174b6e42',image_owner_project_name='tempest-TestStampPattern-1784819717',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1784819717-project-member',image_user_id='96586584970e41a7be230fa812eee595',network_allocated='True',owner_project_name='tempest-TestStampPattern-1784819717',owner_user_name='tempest-TestStampPattern-1784819717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:14:45Z,user_data=None,user_id='96586584970e41a7be230fa812eee595',uuid=0138f302-8a57-4060-b476-ff1d673fa02a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converting VIF {"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG os_vif [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3419cdf1-71da-5d43-831f-39c4432a394a', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:14:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33b42049-03, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33b42049-03, col_values=(('qos', UUID('dd5c3041-5383-4617-afa7-510db555d656')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33b42049-03, col_values=(('external_ids', {'iface-id': '33b42049-0332-4a2a-b067-d3e715b8188c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:da:c5', 'vm-uuid': '0138f302-8a57-4060-b476-ff1d673fa02a'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:48 user nova-compute[74441]: INFO os_vif [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03')
Nov 09 01:14:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No VIF found with MAC fa:16:3e:e3:da:c5, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updated VIF entry in instance network info cache for port 33b42049-0332-4a2a-b067-d3e715b8188c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating instance_info_cache with network_info: [{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-3d1e545b-8e2a-42f5-b2a5-da1e4b18af77 req-969099e0-c818-4adb-896c-c4c1a6020c65 service nova] Releasing lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:14:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:14:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:14:51 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Instance spawned successfully.
Nov 09 01:14:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:14:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:51 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:14:51 user nova-compute[74441]: INFO nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 09 01:14:51 user nova-compute[74441]: DEBUG nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:14:51 user nova-compute[74441]: INFO nova.compute.manager [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Took 7.19 seconds to build instance.
Nov 09 01:14:51 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-25c9cf76-a376-4657-a4ab-e98e5afffe1d tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.293s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-07a431a8-d1bb-4514-88be-b878a0c85cb1 req-41f923d1-79fd-4be7-aa6a-dd4689424455 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-07a431a8-d1bb-4514-88be-b878a0c85cb1 req-41f923d1-79fd-4be7-aa6a-dd4689424455 service nova] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-07a431a8-d1bb-4514-88be-b878a0c85cb1 req-41f923d1-79fd-4be7-aa6a-dd4689424455 service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-07a431a8-d1bb-4514-88be-b878a0c85cb1 req-41f923d1-79fd-4be7-aa6a-dd4689424455 service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:53 user nova-compute[74441]: DEBUG nova.compute.manager [req-07a431a8-d1bb-4514-88be-b878a0c85cb1 req-41f923d1-79fd-4be7-aa6a-dd4689424455 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] No waiting events found dispatching network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:14:53 user nova-compute[74441]: WARNING nova.compute.manager [req-07a431a8-d1bb-4514-88be-b878a0c85cb1 req-41f923d1-79fd-4be7-aa6a-dd4689424455 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received unexpected event network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c for instance with vm_state active and task_state None.
Nov 09 01:14:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-539943d6-615e-4ee4-80a4-60627c7fdf94 req-9f6a9a9d-46c3-40a9-a462-1141a4ac8a88 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:14:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-539943d6-615e-4ee4-80a4-60627c7fdf94 req-9f6a9a9d-46c3-40a9-a462-1141a4ac8a88 service nova] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-539943d6-615e-4ee4-80a4-60627c7fdf94 req-9f6a9a9d-46c3-40a9-a462-1141a4ac8a88 service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-539943d6-615e-4ee4-80a4-60627c7fdf94 req-9f6a9a9d-46c3-40a9-a462-1141a4ac8a88 service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-539943d6-615e-4ee4-80a4-60627c7fdf94 req-9f6a9a9d-46c3-40a9-a462-1141a4ac8a88 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] No waiting events found dispatching network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:14:55 user nova-compute[74441]: WARNING nova.compute.manager [req-539943d6-615e-4ee4-80a4-60627c7fdf94 req-9f6a9a9d-46c3-40a9-a462-1141a4ac8a88 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received unexpected event network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c for instance with vm_state active and task_state None.
Nov 09 01:14:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Triggering sync for uuid 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:14:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:15:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:15:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:15:14 user nova-compute[74441]: INFO nova.compute.claims [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Claim successful on node user
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.network.neutron [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:15:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:15:14 user nova-compute[74441]: DEBUG nova.policy [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8703ed5948ee40e19421b1e2712e99a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d03e0c073f84374b26f1a05026c5276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:15:15 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Creating image(s)
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "/opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "/opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "/opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk 1073741824" returned: 0 in 0.051s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.network.neutron [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Successfully created port: 5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Cannot resize image /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Ensure instance console log exists: /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.neutron [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Successfully updated port: 5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquired lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.neutron [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-changed-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Refreshing instance network info cache due to event network-changed-5817b56c-a24e-4d6f-82d2-83c9931a9f52. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] Acquiring lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.neutron [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.neutron [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updating instance_info_cache with network_info: [{"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Releasing lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Instance network_info: |[{"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] Acquired lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.neutron [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Refreshing network info cache for port 5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Start _get_guest_xml network_info=[{"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:15:16 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:15:16 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-14644821',display_name='tempest-VolumesSnapshotTestJSON-instance-14644821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-14644821',id=47,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/+5mwdc75QhLA/dj1/GtqgZU3lZ8UPzLV4hXnM47PsTJeODm3A78iAsbJp4aB/QzX0kZYYpqj8nNfYL7p3ZdZVC0NKJrMxiCArec8rbkhhaZRcFl8LsFF7P9/6+ZEPJw==',key_name='tempest-keypair-230901055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d03e0c073f84374b26f1a05026c5276',ramdisk_id='',reservation_id='r-fnl0oboz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971652422',owner_user_name='tempest-VolumesSnapshotTestJSON-1971652422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:15:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8703ed5948ee40e19421b1e2712e99a7',uuid=11cb1e64-ca68-49ca-8822-a265b841f00c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converting VIF {"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.objects.instance [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'pci_devices' on Instance uuid 11cb1e64-ca68-49ca-8822-a265b841f00c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:15:16 user nova-compute[74441]:   <uuid>11cb1e64-ca68-49ca-8822-a265b841f00c</uuid>
Nov 09 01:15:16 user nova-compute[74441]:   <name>instance-0000002f</name>
Nov 09 01:15:16 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:15:16 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:15:16 user nova-compute[74441]:   <metadata>
Nov 09 01:15:16 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:15:16 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:15:16 user nova-compute[74441]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-14644821</nova:name>
Nov 09 01:15:16 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:15:16</nova:creationTime>
Nov 09 01:15:16 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:15:16 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:15:16 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:15:16 user nova-compute[74441]:       <nova:owner>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:user uuid="8703ed5948ee40e19421b1e2712e99a7">tempest-VolumesSnapshotTestJSON-1971652422-project-member</nova:user>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:project uuid="2d03e0c073f84374b26f1a05026c5276">tempest-VolumesSnapshotTestJSON-1971652422</nova:project>
Nov 09 01:15:16 user nova-compute[74441]:       </nova:owner>
Nov 09 01:15:16 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:15:16 user nova-compute[74441]:       <nova:ports>
Nov 09 01:15:16 user nova-compute[74441]:         <nova:port uuid="5817b56c-a24e-4d6f-82d2-83c9931a9f52">
Nov 09 01:15:16 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 01:15:16 user nova-compute[74441]:         </nova:port>
Nov 09 01:15:16 user nova-compute[74441]:       </nova:ports>
Nov 09 01:15:16 user nova-compute[74441]:     </nova:instance>
Nov 09 01:15:16 user nova-compute[74441]:   </metadata>
Nov 09 01:15:16 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:15:16 user nova-compute[74441]:     <system>
Nov 09 01:15:16 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:15:16 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:15:16 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:15:16 user nova-compute[74441]:       <entry name="serial">11cb1e64-ca68-49ca-8822-a265b841f00c</entry>
Nov 09 01:15:16 user nova-compute[74441]:       <entry name="uuid">11cb1e64-ca68-49ca-8822-a265b841f00c</entry>
Nov 09 01:15:16 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:15:16 user nova-compute[74441]:     </system>
Nov 09 01:15:16 user nova-compute[74441]:   </sysinfo>
Nov 09 01:15:16 user nova-compute[74441]:   <os>
Nov 09 01:15:16 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:15:16 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:15:16 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:15:16 user nova-compute[74441]:   </os>
Nov 09 01:15:16 user nova-compute[74441]:   <features>
Nov 09 01:15:16 user nova-compute[74441]:     <acpi/>
Nov 09 01:15:16 user nova-compute[74441]:     <apic/>
Nov 09 01:15:16 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:15:16 user nova-compute[74441]:   </features>
Nov 09 01:15:16 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:15:16 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:15:16 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:15:16 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:15:16 user nova-compute[74441]:   </clock>
Nov 09 01:15:16 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:15:16 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:15:16 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:15:16 user nova-compute[74441]:   </cpu>
Nov 09 01:15:16 user nova-compute[74441]:   <devices>
Nov 09 01:15:16 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:15:16 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:15:16 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk"/>
Nov 09 01:15:16 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:15:16 user nova-compute[74441]:     </disk>
Nov 09 01:15:16 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:15:16 user nova-compute[74441]:       <mac address="fa:16:3e:91:38:31"/>
Nov 09 01:15:16 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:15:16 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:15:16 user nova-compute[74441]:       <target dev="tap5817b56c-a2"/>
Nov 09 01:15:16 user nova-compute[74441]:     </interface>
Nov 09 01:15:16 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:15:16 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/console.log" append="off"/>
Nov 09 01:15:16 user nova-compute[74441]:     </serial>
Nov 09 01:15:16 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:15:16 user nova-compute[74441]:     <video>
Nov 09 01:15:16 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:15:16 user nova-compute[74441]:     </video>
Nov 09 01:15:16 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:15:16 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:15:16 user nova-compute[74441]:     </rng>
Nov 09 01:15:16 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:15:16 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:15:16 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:15:16 user nova-compute[74441]:     </memballoon>
Nov 09 01:15:16 user nova-compute[74441]:   </devices>
Nov 09 01:15:16 user nova-compute[74441]: </domain>
Nov 09 01:15:16 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-14644821',display_name='tempest-VolumesSnapshotTestJSON-instance-14644821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-14644821',id=47,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/+5mwdc75QhLA/dj1/GtqgZU3lZ8UPzLV4hXnM47PsTJeODm3A78iAsbJp4aB/QzX0kZYYpqj8nNfYL7p3ZdZVC0NKJrMxiCArec8rbkhhaZRcFl8LsFF7P9/6+ZEPJw==',key_name='tempest-keypair-230901055',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d03e0c073f84374b26f1a05026c5276',ramdisk_id='',reservation_id='r-fnl0oboz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971652422',owner_user_name='tempest-VolumesSnapshotTestJSON-1971652422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:15:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8703ed5948ee40e19421b1e2712e99a7',uuid=11cb1e64-ca68-49ca-8822-a265b841f00c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converting VIF {"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG os_vif [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ea46a06-c4be-5ed2-8933-ca033f1d9778', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5817b56c-a2, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5817b56c-a2, col_values=(('qos', UUID('b22ba83c-11fa-45c1-befd-edbc141722e9')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5817b56c-a2, col_values=(('external_ids', {'iface-id': '5817b56c-a24e-4d6f-82d2-83c9931a9f52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:38:31', 'vm-uuid': '11cb1e64-ca68-49ca-8822-a265b841f00c'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:16 user nova-compute[74441]: INFO os_vif [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2')
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:15:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No VIF found with MAC fa:16:3e:91:38:31, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:15:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updated VIF entry in instance network info cache for port 5817b56c-a24e-4d6f-82d2-83c9931a9f52. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:15:17 user nova-compute[74441]: DEBUG nova.network.neutron [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updating instance_info_cache with network_info: [{"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:15:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-7b95abd5-1a5b-4018-b9ef-3c4686113457 req-8021d882-6fc6-499e-aed1-e51d8b610f53 service nova] Releasing lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-a33398ce-0e82-4a77-97ef-b6245b82de20 req-93e4e98c-e9e1-4db2-b49c-f58a934e2604 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a33398ce-0e82-4a77-97ef-b6245b82de20 req-93e4e98c-e9e1-4db2-b49c-f58a934e2604 service nova] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a33398ce-0e82-4a77-97ef-b6245b82de20 req-93e4e98c-e9e1-4db2-b49c-f58a934e2604 service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a33398ce-0e82-4a77-97ef-b6245b82de20 req-93e4e98c-e9e1-4db2-b49c-f58a934e2604 service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG nova.compute.manager [req-a33398ce-0e82-4a77-97ef-b6245b82de20 req-93e4e98c-e9e1-4db2-b49c-f58a934e2604 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] No waiting events found dispatching network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:15:18 user nova-compute[74441]: WARNING nova.compute.manager [req-a33398ce-0e82-4a77-97ef-b6245b82de20 req-93e4e98c-e9e1-4db2-b49c-f58a934e2604 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received unexpected event network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 for instance with vm_state building and task_state spawning.
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-c0f632c0-5fa2-4b71-8bfb-38974002c7c8 req-6f802e22-469e-404d-929a-21521401280e service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c0f632c0-5fa2-4b71-8bfb-38974002c7c8 req-6f802e22-469e-404d-929a-21521401280e service nova] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c0f632c0-5fa2-4b71-8bfb-38974002c7c8 req-6f802e22-469e-404d-929a-21521401280e service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c0f632c0-5fa2-4b71-8bfb-38974002c7c8 req-6f802e22-469e-404d-929a-21521401280e service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.compute.manager [req-c0f632c0-5fa2-4b71-8bfb-38974002c7c8 req-6f802e22-469e-404d-929a-21521401280e service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] No waiting events found dispatching network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:15:20 user nova-compute[74441]: WARNING nova.compute.manager [req-c0f632c0-5fa2-4b71-8bfb-38974002c7c8 req-6f802e22-469e-404d-929a-21521401280e service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received unexpected event network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 for instance with vm_state building and task_state spawning.
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:15:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Instance spawned successfully.
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:15:20 user nova-compute[74441]: INFO nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 09 01:15:20 user nova-compute[74441]: DEBUG nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:15:20 user nova-compute[74441]: INFO nova.compute.manager [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Took 6.31 seconds to build instance.
Nov 09 01:15:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-aff9b3c5-89b4-4e6e-8f65-a5399f325ad2 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.424s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:15:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8470MB free_disk=24.836307525634766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0138f302-8a57-4060-b476-ff1d673fa02a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 11cb1e64-ca68-49ca-8822-a265b841f00c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:15:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:15:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:15:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:15:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:15:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:15:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:15:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:15:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:15:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:46 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-changed-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Refreshing instance network info cache due to event network-changed-dfb1522a-a9f7-4307-aa00-6466121817ec. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] Acquiring lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] Acquired lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Refreshing network info cache for port dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updated VIF entry in instance network info cache for port dfb1522a-a9f7-4307-aa00-6466121817ec. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:15:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-841e6a64-b098-4d71-92ac-ec804dc4ae9a req-658a5897-2c66-4630-8e30-319b269058f4 service nova] Releasing lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:15:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG nova.objects.instance [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:15:54 user nova-compute[74441]: INFO nova.compute.manager [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attaching volume 21cbfd57-d824-470b-aa08-ed83e861085b to /dev/vdb
Nov 09 01:15:54 user nova-compute[74441]: DEBUG os_brick.utils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[666e3d9f-ccf4-4edb-b9c8-998d2fbfce26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbebb89-e159-4c99-a934-887f171fce09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbfea1d-ff2b-47b2-b8ff-d2dbc01504c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425918c-0522-4ac7-86fa-3be8a9d02c62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:15:54 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:15:54 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff0536-9960-413e-8c7d-bf6ac489c91b]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG os_brick.utils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:15:54 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating existing volume attachment record: 0456620f-f73c-4e70-9991-d557959a00ab {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:15:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:15:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:16:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "1c60bede-c7da-47dd-891b-637e2725c93c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:16:10 user nova-compute[74441]: INFO nova.compute.claims [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Claim successful on node user
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.network.neutron [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:16:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:16:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Creating image(s)
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "/opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "/opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:10 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.208s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG nova.policy [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3d69c5c89549aabe1b1a3137a10c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '126cd89763fb49128e85e5fc8312da66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk 1073741824" returned: 0 in 0.059s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.178s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Cannot resize image /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Ensure instance console log exists: /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Successfully created port: ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Successfully updated port: ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "refresh_cache-1c60bede-c7da-47dd-891b-637e2725c93c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquired lock "refresh_cache-1c60bede-c7da-47dd-891b-637e2725c93c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-changed-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Refreshing instance network info cache due to event network-changed-ebd54c5c-5c31-460d-84bb-1f294579ac16. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] Acquiring lock "refresh_cache-1c60bede-c7da-47dd-891b-637e2725c93c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:16:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Updating instance_info_cache with network_info: [{"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Releasing lock "refresh_cache-1c60bede-c7da-47dd-891b-637e2725c93c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Instance network_info: |[{"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] Acquired lock "refresh_cache-1c60bede-c7da-47dd-891b-637e2725c93c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.neutron [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Refreshing network info cache for port ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Start _get_guest_xml network_info=[{"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:16:13 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:16:13 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1515608509',display_name='tempest-VolumesNegativeTest-instance-1515608509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1515608509',id=48,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='126cd89763fb49128e85e5fc8312da66',ramdisk_id='',reservation_id='r-vzhgp888',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1976235851',owner_user_name='tempest-VolumesNegativeTest-1976235851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:16:11Z,user_data=None,user_id='4d3d69c5c89549aabe1b1a3137a10c23',uuid=1c60bede-c7da-47dd-891b-637e2725c93c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Converting VIF {"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.objects.instance [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c60bede-c7da-47dd-891b-637e2725c93c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:16:13 user nova-compute[74441]:   <uuid>1c60bede-c7da-47dd-891b-637e2725c93c</uuid>
Nov 09 01:16:13 user nova-compute[74441]:   <name>instance-00000030</name>
Nov 09 01:16:13 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:16:13 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:16:13 user nova-compute[74441]:   <metadata>
Nov 09 01:16:13 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:16:13 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:16:13 user nova-compute[74441]:       <nova:name>tempest-VolumesNegativeTest-instance-1515608509</nova:name>
Nov 09 01:16:13 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:16:13</nova:creationTime>
Nov 09 01:16:13 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:16:13 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:16:13 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:16:13 user nova-compute[74441]:       <nova:owner>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:user uuid="4d3d69c5c89549aabe1b1a3137a10c23">tempest-VolumesNegativeTest-1976235851-project-member</nova:user>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:project uuid="126cd89763fb49128e85e5fc8312da66">tempest-VolumesNegativeTest-1976235851</nova:project>
Nov 09 01:16:13 user nova-compute[74441]:       </nova:owner>
Nov 09 01:16:13 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:16:13 user nova-compute[74441]:       <nova:ports>
Nov 09 01:16:13 user nova-compute[74441]:         <nova:port uuid="ebd54c5c-5c31-460d-84bb-1f294579ac16">
Nov 09 01:16:13 user nova-compute[74441]:           <nova:ip type="fixed" address="192.168.233.138" ipVersion="4"/>
Nov 09 01:16:13 user nova-compute[74441]:         </nova:port>
Nov 09 01:16:13 user nova-compute[74441]:       </nova:ports>
Nov 09 01:16:13 user nova-compute[74441]:     </nova:instance>
Nov 09 01:16:13 user nova-compute[74441]:   </metadata>
Nov 09 01:16:13 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:16:13 user nova-compute[74441]:     <system>
Nov 09 01:16:13 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:16:13 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:16:13 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:16:13 user nova-compute[74441]:       <entry name="serial">1c60bede-c7da-47dd-891b-637e2725c93c</entry>
Nov 09 01:16:13 user nova-compute[74441]:       <entry name="uuid">1c60bede-c7da-47dd-891b-637e2725c93c</entry>
Nov 09 01:16:13 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:16:13 user nova-compute[74441]:     </system>
Nov 09 01:16:13 user nova-compute[74441]:   </sysinfo>
Nov 09 01:16:13 user nova-compute[74441]:   <os>
Nov 09 01:16:13 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:16:13 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:16:13 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:16:13 user nova-compute[74441]:   </os>
Nov 09 01:16:13 user nova-compute[74441]:   <features>
Nov 09 01:16:13 user nova-compute[74441]:     <acpi/>
Nov 09 01:16:13 user nova-compute[74441]:     <apic/>
Nov 09 01:16:13 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:16:13 user nova-compute[74441]:   </features>
Nov 09 01:16:13 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:16:13 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:16:13 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:16:13 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:16:13 user nova-compute[74441]:   </clock>
Nov 09 01:16:13 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:16:13 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:16:13 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:16:13 user nova-compute[74441]:   </cpu>
Nov 09 01:16:13 user nova-compute[74441]:   <devices>
Nov 09 01:16:13 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:16:13 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:16:13 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk"/>
Nov 09 01:16:13 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:16:13 user nova-compute[74441]:     </disk>
Nov 09 01:16:13 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:16:13 user nova-compute[74441]:       <mac address="fa:16:3e:9d:3d:fb"/>
Nov 09 01:16:13 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:16:13 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:16:13 user nova-compute[74441]:       <target dev="tapebd54c5c-5c"/>
Nov 09 01:16:13 user nova-compute[74441]:     </interface>
Nov 09 01:16:13 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:16:13 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/console.log" append="off"/>
Nov 09 01:16:13 user nova-compute[74441]:     </serial>
Nov 09 01:16:13 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:16:13 user nova-compute[74441]:     <video>
Nov 09 01:16:13 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:16:13 user nova-compute[74441]:     </video>
Nov 09 01:16:13 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:16:13 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:16:13 user nova-compute[74441]:     </rng>
Nov 09 01:16:13 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:16:13 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:16:13 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:16:13 user nova-compute[74441]:     </memballoon>
Nov 09 01:16:13 user nova-compute[74441]:   </devices>
Nov 09 01:16:13 user nova-compute[74441]: </domain>
Nov 09 01:16:13 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1515608509',display_name='tempest-VolumesNegativeTest-instance-1515608509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1515608509',id=48,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='126cd89763fb49128e85e5fc8312da66',ramdisk_id='',reservation_id='r-vzhgp888',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1976235851',owner_user_name='tempest-VolumesNegativeTest-1976235851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:16:11Z,user_data=None,user_id='4d3d69c5c89549aabe1b1a3137a10c23',uuid=1c60bede-c7da-47dd-891b-637e2725c93c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Converting VIF {"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG os_vif [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '047eb88f-0b2a-5ff2-b248-5cd85e6de3b8', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd54c5c-5c, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebd54c5c-5c, col_values=(('qos', UUID('ce613fa3-c4c4-4e6a-991e-dcc3f366df67')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebd54c5c-5c, col_values=(('external_ids', {'iface-id': 'ebd54c5c-5c31-460d-84bb-1f294579ac16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:3d:fb', 'vm-uuid': '1c60bede-c7da-47dd-891b-637e2725c93c'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:13 user nova-compute[74441]: INFO os_vif [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c')
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] No VIF found with MAC fa:16:3e:9d:3d:fb, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.neutron [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Updated VIF entry in instance network info cache for port ebd54c5c-5c31-460d-84bb-1f294579ac16. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG nova.network.neutron [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Updating instance_info_cache with network_info: [{"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:16:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-dee3f8ad-8719-48ca-819b-a490342d52ee req-d5703b99-04e9-4941-b905-2ea2dfa77d4d service nova] Releasing lock "refresh_cache-1c60bede-c7da-47dd-891b-637e2725c93c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:16:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-ce4af538-c96c-44fb-b957-2400c1adf6bf req-308a3fe6-e90a-4a88-a444-00a3f43a0ff4 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ce4af538-c96c-44fb-b957-2400c1adf6bf req-308a3fe6-e90a-4a88-a444-00a3f43a0ff4 service nova] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ce4af538-c96c-44fb-b957-2400c1adf6bf req-308a3fe6-e90a-4a88-a444-00a3f43a0ff4 service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-ce4af538-c96c-44fb-b957-2400c1adf6bf req-308a3fe6-e90a-4a88-a444-00a3f43a0ff4 service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG nova.compute.manager [req-ce4af538-c96c-44fb-b957-2400c1adf6bf req-308a3fe6-e90a-4a88-a444-00a3f43a0ff4 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] No waiting events found dispatching network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:16:15 user nova-compute[74441]: WARNING nova.compute.manager [req-ce4af538-c96c-44fb-b957-2400c1adf6bf req-308a3fe6-e90a-4a88-a444-00a3f43a0ff4 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received unexpected event network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 for instance with vm_state building and task_state spawning.
Nov 09 01:16:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:16:16 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Instance spawned successfully.
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:16:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:16:17 user nova-compute[74441]: INFO nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 09 01:16:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:16:17 user nova-compute[74441]: INFO nova.compute.manager [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Took 6.95 seconds to build instance.
Nov 09 01:16:17 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-49b6a79b-8d20-43e1-b791-d9437edac36e tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "1c60bede-c7da-47dd-891b-637e2725c93c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.055s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-1794f4b3-df56-4a7c-8075-87c610140474 req-273c8d1a-595b-4c48-b1bd-76072d847038 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1794f4b3-df56-4a7c-8075-87c610140474 req-273c8d1a-595b-4c48-b1bd-76072d847038 service nova] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1794f4b3-df56-4a7c-8075-87c610140474 req-273c8d1a-595b-4c48-b1bd-76072d847038 service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-1794f4b3-df56-4a7c-8075-87c610140474 req-273c8d1a-595b-4c48-b1bd-76072d847038 service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG nova.compute.manager [req-1794f4b3-df56-4a7c-8075-87c610140474 req-273c8d1a-595b-4c48-b1bd-76072d847038 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] No waiting events found dispatching network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:16:17 user nova-compute[74441]: WARNING nova.compute.manager [req-1794f4b3-df56-4a7c-8075-87c610140474 req-273c8d1a-595b-4c48-b1bd-76072d847038 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received unexpected event network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 for instance with vm_state active and task_state None.
Nov 09 01:16:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juGSkHfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:16:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:16:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:16:17 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:16:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:16:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:16:17 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:16:17 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9615f987-2d2c-4a88-becb-698961b2e02f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:16:18 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9d2de-7a8b-4cd8-90aa-59053d8c3fb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b] added
Nov 09 01:16:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0280d064-f947-4b7f-bdd6-2a6f17c78012]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab897d5b-3e36-46d2-9c66-c6a3db9a5dec]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v juGSkHfo {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v juGSkHfo" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a6f87e-d11a-4505-ba5a-20b940d77a86]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'juGSkHfo'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd8d6f8-9d02-4892-8db1-4a114ee9f69a]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0efffd1-7a0e-43de-aabd-ab38618df2d1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 01:16:18 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 01:16:18 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:16:18 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 01:16:18 user nova-compute[74441]: 
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef85575-4790-454c-978c-8f2753704280]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260]
Nov 09 01:16:18 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260] successful.
Nov 09 01:16:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bfcf2b-df65-4f95-918f-9edd94d8cdc2]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc4c466-f2b6-44c2-8291-203474a8ba9f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:16:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:16:18 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129890c-0e5f-42c9-a2bd-82364fd0ab46]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juGSkHfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23833363434336461', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833363434336461', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:16:19 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:16:19 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:16:19 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:16:19 user nova-compute[74441]:   <serial>21cbfd57-d824-470b-aa08-ed83e861085b</serial>
Nov 09 01:16:19 user nova-compute[74441]: </disk>
Nov 09 01:16:19 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No VIF found with MAC fa:16:3e:d3:dc:d3, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:16:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-dbda0ce2-edba-49f0-b74f-9bb7a79efaa5 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.367s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:16:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=24.80484390258789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0138f302-8a57-4060-b476-ff1d673fa02a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 11cb1e64-ca68-49ca-8822-a265b841f00c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1c60bede-c7da-47dd-891b-637e2725c93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:16:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:16:24 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:16:24 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:16:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:16:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:26 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG nova.objects.instance [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:27 user nova-compute[74441]: INFO nova.compute.manager [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attaching volume 4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 to /dev/vdc
Nov 09 01:16:27 user nova-compute[74441]: DEBUG os_brick.utils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[87223daf-13df-4783-beb5-99a5ffd49825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f2b78-20c8-4c7c-8898-9a519ccd5f64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f2ef12-da39-4108-8434-4251ffa59973]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[29505cf0-601d-41fe-a186-79a6aa653da6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:16:27 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:16:27 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2cec04-77e5-4869-84ad-da409e8d91e1]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG os_brick.utils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:16:27 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating existing volume attachment record: 7e1f7f8c-6d6c-4981-ae39-588325145aab {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:16:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:16:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:16:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-changed-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:16:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Refreshing instance network info cache due to event network-changed-33b42049-0332-4a2a-b067-d3e715b8188c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:16:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] Acquiring lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:16:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] Acquired lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:16:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Refreshing network info cache for port 33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:16:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updated VIF entry in instance network info cache for port 33b42049-0332-4a2a-b067-d3e715b8188c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:16:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating instance_info_cache with network_info: [{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:16:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-abd67c9f-a69d-4917-aa19-214b06e14bfc req-0281ebb7-4f77-4879-8bd4-0b7d97a80e47 service nova] Releasing lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'flavor' on Instance uuid 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:16:38 user nova-compute[74441]: INFO nova.compute.manager [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Attaching volume 42ec5a64-b2e3-419b-909f-c118b253534c to /dev/vdb
Nov 09 01:16:38 user nova-compute[74441]: DEBUG os_brick.utils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[310f8b0d-cc81-4aa9-92fb-621a7a448292]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c84f8-1262-49ee-ae47-0a06be4d2034]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5bf44a-3653-4c75-85d2-97045dddd37c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3067316-d9ed-4345-af71-aa23604358a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:16:38 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:16:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da57451-de15-462d-983a-845c00a2ab07]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG os_brick.utils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating existing volume attachment record: bb323af4-8207-40aa-8431-f79173ae9a72 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:16:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-changed-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Refreshing instance network info cache due to event network-changed-5817b56c-a24e-4d6f-82d2-83c9931a9f52. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] Acquiring lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] Acquired lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG nova.network.neutron [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Refreshing network info cache for port 5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'flavor' on Instance uuid 11cb1e64-ca68-49ca-8822-a265b841f00c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:17:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Ignoring supplied device name: /dev/vdb
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:05 user nova-compute[74441]: INFO nova.compute.manager [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Attaching volume 2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 to /dev/vdb
Nov 09 01:17:05 user nova-compute[74441]: DEBUG nova.network.neutron [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updated VIF entry in instance network info cache for port 5817b56c-a24e-4d6f-82d2-83c9931a9f52. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG nova.network.neutron [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updating instance_info_cache with network_info: [{"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d0a68d94-6202-4a0c-9193-c8412e09f1bf req-4d7994fe-7525-40dd-ba3e-fcafe7446970 service nova] Releasing lock "refresh_cache-11cb1e64-ca68-49ca-8822-a265b841f00c" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG os_brick.utils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a75f88-523a-4985-9c28-497de1054dfe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee34f2-4957-4d52-bf0c-3f76daf17fd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28973ebb-2437-4c13-aa3f-557285239163]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c15df0-fd47-4602-b542-bb6c2317e4a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:17:06 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:17:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ccd2b0-e4b8-4f2a-8943-cca070e5ef4d]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG os_brick.utils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:17:06 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updating existing volume attachment record: 839128ce-6774-4a97-8c0d-7fddc278c2e2 {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [{"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:17:08 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:17:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMEhntcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:17:14 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:14 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:14 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e3d09-9bb3-48c4-9d39-c50567c9a2e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:17:14 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a56f56-3b9f-4900-aba9-dd22797bb394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037] added
Nov 09 01:17:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c81c6f-f34c-43d5-a5da-b73ba2b0f241]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad06a0d6-8807-42d6-a1ee-e63daa41966f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMEhntcG {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMEhntcG" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a76250-c17b-46be-8532-d5ca834ee612]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HMEhntcG'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[06876fca-740b-481c-a224-7d30b667f5d8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f912d6-e206-4249-b648-82c8a7819f22]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:14 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a9215-b05b-4214-a52c-0088c6ce1f8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260]
Nov 09 01:17:15 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260] successful.
Nov 09 01:17:15 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8433c943-1874-4c76-abe9-85d508870cf8]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b5f24b-93d4-4b83-a799-8476c337ae0c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:15 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:15 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:15 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:15 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFLECVcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:17:15 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d0c8aa-a3d2-4221-ae5f-650214b9ca0a]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:17:15 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMEhntcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23664636537363462', 'path': '/dev/sdc'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664636537363462', 'path': '/dev/sdc'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.012s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:16 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:16 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.objects.instance [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de458c7-fff7-4262-b993-7fbbd5bff305]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:17:16 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:17:16 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:16 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 01:17:16 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 01:17:16 user nova-compute[74441]:   <serial>4ecfcefa-d5cf-4140-ad21-f6e5dc37c037</serial>
Nov 09 01:17:16 user nova-compute[74441]: </disk>
Nov 09 01:17:16 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3270dd-53ac-419d-ba23-61d36ece1976]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c] added
Nov 09 01:17:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19c4f1-8610-43ac-9cdc-65b4ba7bf523]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98642d-e272-40cc-bcac-751cc7136214]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFLECVcH {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFLECVcH" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4bb17-0c43-4c4b-ab94-c20604d14505]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFLECVcH'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[286472cf-1393-45da-863a-eb0e87ab8d00]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f495a45c-7715-4708-ae00-f68d8b788740]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:16 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:16 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae8741-b57a-4a22-ad0f-5e8d36a11467]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260]
Nov 09 01:17:16 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260] successful.
Nov 09 01:17:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c4e8c7-c304-4ea5-9d3a-4a392572f701]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be574a4-2528-489f-a089-06481f7dd377]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:16 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:16 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:16 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:16 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:16 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31d70c8-983c-437f-b384-e48dce290733]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFLECVcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] No VIF found with MAC fa:16:3e:d3:dc:d3, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:17:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-b0f33d46-32df-47a9-bf62-3ab82b1a222c tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.275s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] <== connect_volume: return (2333ms) {'type': 'block', 'scsi_wwn': '23233346530626164', 'path': '/dev/sdd'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233346530626164', 'path': '/dev/sdd'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.objects.instance [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'flavor' on Instance uuid 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:17:17 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:17 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:17:17 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:17:17 user nova-compute[74441]:   <serial>42ec5a64-b2e3-419b-909f-c118b253534c</serial>
Nov 09 01:17:17 user nova-compute[74441]: </disk>
Nov 09 01:17:17 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:17 user nova-compute[74441]: INFO nova.compute.manager [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Detaching volume 21cbfd57-d824-470b-aa08-ed83e861085b
Nov 09 01:17:17 user nova-compute[74441]: INFO nova.virt.block_device [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attempting to driver detach volume 21cbfd57-d824-470b-aa08-ed83e861085b from mountpoint /dev/vdb
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Attempting to detach device vdb from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:17:17 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:17 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:17:17 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:17:17 user nova-compute[74441]:   <serial>21cbfd57-d824-470b-aa08-ed83e861085b</serial>
Nov 09 01:17:17 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:17:17 user nova-compute[74441]: </disk>
Nov 09 01:17:17 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:17:17 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully detached device vdb from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the persistent domain config.
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:17:17 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:17 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:17:17 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:17:17 user nova-compute[74441]:   <serial>21cbfd57-d824-470b-aa08-ed83e861085b</serial>
Nov 09 01:17:17 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:17:17 user nova-compute[74441]: </disk>
Nov 09 01:17:17 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:17 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] No VIF found with MAC fa:16:3e:e3:da:c5, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:17:18 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-533cee27-1bcf-421b-9680-92ff73939689 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.820s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:18 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:17:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:17:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:20 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:20 user nova-compute[74441]: INFO nova.compute.manager [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Detaching volume 42ec5a64-b2e3-419b-909f-c118b253534c
Nov 09 01:17:20 user nova-compute[74441]: INFO nova.virt.block_device [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Attempting to driver detach volume 42ec5a64-b2e3-419b-909f-c118b253534c from mountpoint /dev/vdb
Nov 09 01:17:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Attempting to detach device vdb from instance 0138f302-8a57-4060-b476-ff1d673fa02a from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:17:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:17:20 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:20 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:17:20 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:17:20 user nova-compute[74441]:   <serial>42ec5a64-b2e3-419b-909f-c118b253534c</serial>
Nov 09 01:17:20 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:17:20 user nova-compute[74441]: </disk>
Nov 09 01:17:20 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:17:20 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully detached device vdb from instance 0138f302-8a57-4060-b476-ff1d673fa02a from the persistent domain config.
Nov 09 01:17:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0138f302-8a57-4060-b476-ff1d673fa02a from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:17:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:17:20 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:20 user nova-compute[74441]:   <source dev="/dev/sdd"/>
Nov 09 01:17:20 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:17:20 user nova-compute[74441]:   <serial>42ec5a64-b2e3-419b-909f-c118b253534c</serial>
Nov 09 01:17:20 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:17:20 user nova-compute[74441]: </disk>
Nov 09 01:17:20 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:17:20 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:21 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:22 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:17:23 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.774513244628906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0138f302-8a57-4060-b476-ff1d673fa02a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 11cb1e64-ca68-49ca-8822-a265b841f00c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 1c60bede-c7da-47dd-891b-637e2725c93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:17:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:26 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:26 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuqpStRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:17:29 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:29 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:29 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[919b2a68-7e83-49de-916a-540d5fe35d60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:17:29 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c5851-6eff-48d1-bc43-c725f5d1982e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2] added
Nov 09 01:17:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667c8b6-6a72-411a-9026-1d68acb045cd]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46eb133-bd07-4615-9429-9a1d8cccc11d]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuqpStRW {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuqpStRW" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[10534eb0-0c8f-428d-9631-135b1e1b1352]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BuqpStRW'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cce9cc-d7fa-4807-ac4d-90a30ee95ece]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[f022275e-4ea2-4bda-90b9-912e357a3253]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:29 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:29 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:29 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:29 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:29 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:29 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7e95e-a536-402c-a259-5778aba44359]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260]
Nov 09 01:17:30 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260] successful.
Nov 09 01:17:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[46318cf5-038e-4c7d-b2d1-4b117b1b9e99]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae46ce-9efe-4d74-bdb0-db6160f0948f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:30 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:30 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:30 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:17:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:30 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:30 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:30 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:17:30 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[035aa508-ef23-4d29-b193-2f801fad5921]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuqpStRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:17:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23065373532663766', 'path': '/dev/sde'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065373532663766', 'path': '/dev/sde'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'flavor' on Instance uuid 11cb1e64-ca68-49ca-8822-a265b841f00c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:17:31 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:31 user nova-compute[74441]:   <source dev="/dev/sde"/>
Nov 09 01:17:31 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:17:31 user nova-compute[74441]:   <serial>2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2</serial>
Nov 09 01:17:31 user nova-compute[74441]: </disk>
Nov 09 01:17:31 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No VIF found with MAC fa:16:3e:91:38:31, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:17:31 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3cf75109-7c89-4ab2-b1e9-b52824ec4c99 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.843s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:17:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:38 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 is timed out.
Nov 09 01:17:38 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully detached device vdb from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the live domain config.
Nov 09 01:17:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'juGSkHfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:17:38 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6b792-7f85-41f2-a273-b65baece6eae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:17:38 user nova-compute[74441]: No targets found.
Nov 09 01:17:38 user nova-compute[74441]: iSNS:
Nov 09 01:17:38 user nova-compute[74441]: No targets found.
Nov 09 01:17:38 user nova-compute[74441]: STATIC:
Nov 09 01:17:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037
Nov 09 01:17:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c
Nov 09 01:17:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2
Nov 09 01:17:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:38 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b
Nov 09 01:17:38 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:38 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:38 user nova-compute[74441]: FIRMWARE:
Nov 09 01:17:38 user nova-compute[74441]: No targets found.
Nov 09 01:17:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:17:38 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:17:38 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad364ff-ad15-4ec1-a7f3-9928fa7d6b16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f24de-faea-49c7-92dd-ddf9c1d81952]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:38 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:38 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:38 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:17:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b (non-flash)
Nov 09 01:17:38 user nova-compute[74441]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:38 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:38 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:17:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c65d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d66de-5cc5-4580-9c49-6da5a8ca9bb9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d827e310-2771-4a32-86bd-5236d015ffce]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[416dbf5e-12e6-4818-8986-2496c1574b28]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b271b617-da58-48de-9d5a-512057f689c3]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb31f00-18d0-4a59-be9e-44e645aa41b5]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[09691f20-747e-48dd-84d9-cf6956ca1afa]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260]
Nov 09 01:17:38 user nova-compute[74441]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b, portal: 172.16.0.220,3260] successful.
Nov 09 01:17:38 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21cbfd57-d824-470b-aa08-ed83e861085b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1f79b-592a-4ae6-b4fd-5fcfd8c6ef71]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== disconnect_volume: return (306ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:39 user nova-compute[74441]: DEBUG nova.objects.instance [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:17:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-8acc8b06-4e5c-4dc8-ab39-24e01caf81e3 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.907s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:17:40 user nova-compute[74441]: INFO nova.compute.manager [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Detaching volume 4ecfcefa-d5cf-4140-ad21-f6e5dc37c037
Nov 09 01:17:40 user nova-compute[74441]: INFO nova.virt.block_device [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Attempting to driver detach volume 4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 from mountpoint /dev/vdc
Nov 09 01:17:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Attempting to detach device vdc from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:17:40 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:40 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 01:17:40 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 01:17:40 user nova-compute[74441]:   <serial>4ecfcefa-d5cf-4140-ad21-f6e5dc37c037</serial>
Nov 09 01:17:40 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 01:17:40 user nova-compute[74441]: </disk>
Nov 09 01:17:40 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:17:40 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully detached device vdc from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the persistent domain config.
Nov 09 01:17:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:17:40 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:17:40 user nova-compute[74441]:   <source dev="/dev/sdc"/>
Nov 09 01:17:40 user nova-compute[74441]:   <target dev="vdc" bus="virtio"/>
Nov 09 01:17:40 user nova-compute[74441]:   <serial>4ecfcefa-d5cf-4140-ad21-f6e5dc37c037</serial>
Nov 09 01:17:40 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 01:17:40 user nova-compute[74441]: </disk>
Nov 09 01:17:40 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:17:40 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0138f302-8a57-4060-b476-ff1d673fa02a is timed out.
Nov 09 01:17:40 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully detached device vdb from instance 0138f302-8a57-4060-b476-ff1d673fa02a from the live domain config.
Nov 09 01:17:40 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFLECVcH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:17:40 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:17:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee07d226-a40e-40d0-8bf6-cc7f2e86e80b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:17:40 user nova-compute[74441]: No targets found.
Nov 09 01:17:40 user nova-compute[74441]: iSNS:
Nov 09 01:17:40 user nova-compute[74441]: No targets found.
Nov 09 01:17:40 user nova-compute[74441]: STATIC:
Nov 09 01:17:40 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037
Nov 09 01:17:40 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:40 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:40 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c
Nov 09 01:17:40 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:40 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:40 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2
Nov 09 01:17:40 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:17:40 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:17:40 user nova-compute[74441]: FIRMWARE:
Nov 09 01:17:40 user nova-compute[74441]: No targets found.
Nov 09 01:17:40 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:17:40 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:17:40 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[75500986-e918-4a87-a0aa-3be8ce14c5eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:40 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b070b-6fe0-4be6-b8c1-097fc3047039]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:41 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:41 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:17:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:17:41 user nova-compute[74441]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c (non-flash)
Nov 09 01:17:41 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:17:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c65c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c'): ({'sdd'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Removing single pathed devices sdd {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b1c9bd-3aca-4605-8df4-b0ac4dfc7c58]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e9b03-1cf4-406b-b1f4-f0bcbac28bae]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Flushing IO for device /dev/sdd {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad897db7-d975-46c3-b433-6bea470dd77b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[62857041-3c09-4174-abd7-6baf798dc4e7]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] SCSI volumes sdd have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[84df27bc-aecd-4177-af7a-42e04f120fc1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f4066-1b85-4707-b8ea-b8bac99f70fb]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260]
Nov 09 01:17:41 user nova-compute[74441]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c, portal: 172.16.0.220,3260] successful.
Nov 09 01:17:41 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ec5a64-b2e3-419b-909f-c118b253534c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ba4f8-6147-4a30-b431-ff38dc870efe]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] <== disconnect_volume: return (308ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:17:41 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:17:42 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'flavor' on Instance uuid 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:17:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0c2bb3ea-19a6-43ff-9993-08817779a811 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:17:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:17:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:17:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:17:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:17:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:17:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "1c60bede-c7da-47dd-891b-637e2725c93c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:00 user nova-compute[74441]: INFO nova.compute.manager [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Terminating instance
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.compute.manager [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-b854da98-aab9-4df3-a77b-1a6b21615ede req-b29607e9-5117-4543-893f-a58bf49f0500 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-vif-unplugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b854da98-aab9-4df3-a77b-1a6b21615ede req-b29607e9-5117-4543-893f-a58bf49f0500 service nova] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b854da98-aab9-4df3-a77b-1a6b21615ede req-b29607e9-5117-4543-893f-a58bf49f0500 service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b854da98-aab9-4df3-a77b-1a6b21615ede req-b29607e9-5117-4543-893f-a58bf49f0500 service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-b854da98-aab9-4df3-a77b-1a6b21615ede req-b29607e9-5117-4543-893f-a58bf49f0500 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] No waiting events found dispatching network-vif-unplugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.compute.manager [req-b854da98-aab9-4df3-a77b-1a6b21615ede req-b29607e9-5117-4543-893f-a58bf49f0500 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-vif-unplugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:18:00 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 is timed out.
Nov 09 01:18:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully detached device vdc from instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 from the live domain config.
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMEhntcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:18:00 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:00 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Instance destroyed successfully.
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.objects.instance [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lazy-loading 'resources' on Instance uuid 1c60bede-c7da-47dd-891b-637e2725c93c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[57540e86-1be3-462c-bdaa-5e0270b5d6e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:18:00 user nova-compute[74441]: No targets found.
Nov 09 01:18:00 user nova-compute[74441]: iSNS:
Nov 09 01:18:00 user nova-compute[74441]: No targets found.
Nov 09 01:18:00 user nova-compute[74441]: STATIC:
Nov 09 01:18:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037
Nov 09 01:18:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:18:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:18:00 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2
Nov 09 01:18:00 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:18:00 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:18:00 user nova-compute[74441]: FIRMWARE:
Nov 09 01:18:00 user nova-compute[74441]: No targets found.
Nov 09 01:18:00 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:18:00 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:18:00 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1515608509',display_name='tempest-VolumesNegativeTest-instance-1515608509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1515608509',id=48,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:16:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='126cd89763fb49128e85e5fc8312da66',ramdisk_id='',reservation_id='r-vzhgp888',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1976235851',owner_user_name='tempest-VolumesNegativeTest-1976235851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:16:17Z,user_data=None,user_id='4d3d69c5c89549aabe1b1a3137a10c23',uuid=1c60bede-c7da-47dd-891b-637e2725c93c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Converting VIF {"id": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "address": "fa:16:3e:9d:3d:fb", "network": {"id": "9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "40527f15127d4f1e8218ed81766fc497", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd54c5c-5c", "ovs_interfaceid": "ebd54c5c-5c31-460d-84bb-1f294579ac16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG os_vif [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[747f287e-3704-4620-aa50-ef03b58cbc96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd54c5c-5c, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce613fa3-c4c4-4e6a-991e-dcc3f366df67) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:01 user nova-compute[74441]: INFO os_vif [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:3d:fb,bridge_name='br-int',has_traffic_filtering=True,id=ebd54c5c-5c31-460d-84bb-1f294579ac16,network=Network(9ad7c2fd-fec0-4a5e-b37e-4ce244d7a5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd54c5c-5c')
Nov 09 01:18:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Deleting instance files /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c_del
Nov 09 01:18:01 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Deletion of /opt/stack/data/nova/instances/1c60bede-c7da-47dd-891b-637e2725c93c_del complete
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2548909-3055-4705-9bc9-9b56022833ea]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:18:01 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:18:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 (non-flash)
Nov 09 01:18:01 user nova-compute[74441]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:18:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f013c2cab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037'): ({'sdc'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Removing single pathed devices sdc {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b1a39-63db-4009-8e7f-7c1a361c6621]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c2582-0335-4683-b12a-fcaf99a33a7d]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Flushing IO for device /dev/sdc {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc28c33-4736-47ff-bafb-54d2c78edf88]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: INFO nova.compute.manager [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b201e-91e1-4c69-b1ab-ccb1090739ac]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] SCSI volumes sdc have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ccc7d1-a7db-4167-a042-01252c33bfd4]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb2eb52-e800-401f-8b4d-0e3ceab011a5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260]
Nov 09 01:18:01 user nova-compute[74441]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037, portal: 172.16.0.220,3260] successful.
Nov 09 01:18:01 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ecfcefa-d5cf-4140-ad21-f6e5dc37c037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d4185e-b8d8-45ae-b50a-e9bfb7cb974b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] <== disconnect_volume: return (357ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:18:01 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:18:02 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Took 0.93 seconds to deallocate network for instance.
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-be8b6d80-0590-49a3-97b3-41c049d0855b req-28f3fd64-6ba7-4990-8b88-17efef7ce393 service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-vif-deleted-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:02 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Deleted allocations for instance 1c60bede-c7da-47dd-891b-637e2725c93c
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-fad9451b-d88d-4e39-b798-9c3e0ae448e7 tempest-VolumesNegativeTest-1976235851 tempest-VolumesNegativeTest-1976235851-project-member] Lock "1c60bede-c7da-47dd-891b-637e2725c93c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.objects.instance [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'flavor' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-0b28e3a7-0b70-4b30-a93e-317906386d22 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.233s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-15a4ca44-f0f9-45b7-bb64-38a66402d1f7 req-49d09ee6-52a5-41b7-b08e-e8496aca2adc service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received event network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15a4ca44-f0f9-45b7-bb64-38a66402d1f7 req-49d09ee6-52a5-41b7-b08e-e8496aca2adc service nova] Acquiring lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15a4ca44-f0f9-45b7-bb64-38a66402d1f7 req-49d09ee6-52a5-41b7-b08e-e8496aca2adc service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-15a4ca44-f0f9-45b7-bb64-38a66402d1f7 req-49d09ee6-52a5-41b7-b08e-e8496aca2adc service nova] Lock "1c60bede-c7da-47dd-891b-637e2725c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:02 user nova-compute[74441]: DEBUG nova.compute.manager [req-15a4ca44-f0f9-45b7-bb64-38a66402d1f7 req-49d09ee6-52a5-41b7-b08e-e8496aca2adc service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] No waiting events found dispatching network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:18:02 user nova-compute[74441]: WARNING nova.compute.manager [req-15a4ca44-f0f9-45b7-bb64-38a66402d1f7 req-49d09ee6-52a5-41b7-b08e-e8496aca2adc service nova] [instance: 1c60bede-c7da-47dd-891b-637e2725c93c] Received unexpected event network-vif-plugged-ebd54c5c-5c31-460d-84bb-1f294579ac16 for instance with vm_state deleted and task_state None.
Nov 09 01:18:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:03 user nova-compute[74441]: INFO nova.compute.manager [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Terminating instance
Nov 09 01:18:03 user nova-compute[74441]: DEBUG nova.compute.manager [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-6b60b121-1711-4627-9c98-fc1011e052a6 req-488bca64-01b2-48f4-a18d-21837060876d service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-vif-unplugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6b60b121-1711-4627-9c98-fc1011e052a6 req-488bca64-01b2-48f4-a18d-21837060876d service nova] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6b60b121-1711-4627-9c98-fc1011e052a6 req-488bca64-01b2-48f4-a18d-21837060876d service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-6b60b121-1711-4627-9c98-fc1011e052a6 req-488bca64-01b2-48f4-a18d-21837060876d service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-6b60b121-1711-4627-9c98-fc1011e052a6 req-488bca64-01b2-48f4-a18d-21837060876d service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] No waiting events found dispatching network-vif-unplugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.compute.manager [req-6b60b121-1711-4627-9c98-fc1011e052a6 req-488bca64-01b2-48f4-a18d-21837060876d service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-vif-unplugged-dfb1522a-a9f7-4307-aa00-6466121817ec for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:18:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Instance destroyed successfully.
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.objects.instance [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lazy-loading 'resources' on Instance uuid 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1945739091',display_name='tempest-AttachVolumeTestJSON-server-1945739091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1945739091',id=45,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1lCe5XGCfGBKthWcS8OrZL5pZCw/A6TXNmIPbf8IQLhJApDalYRnIx+PgnJffJKbipBZplwpTHOJivcOssWlHqBjkbjUPPf7zYDemb2H215EfeNavIe4KeVoGBGQBNLw==',key_name='tempest-keypair-1605616455',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01aa9979e78d4597ae023610b56f5a60',ramdisk_id='',reservation_id='r-vemabhvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1454008029',owner_user_name='tempest-AttachVolumeTestJSON-1454008029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d6713a112a64d03a7cd67c304a85ddd',uuid=6a246a92-0eb4-4065-b4d2-d3b8b15f3f54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converting VIF {"id": "dfb1522a-a9f7-4307-aa00-6466121817ec", "address": "fa:16:3e:d3:dc:d3", "network": {"id": "4e9da287-72d8-480e-9136-5a67d56f7c5a", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1936508623-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01aa9979e78d4597ae023610b56f5a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfb1522a-a9", "ovs_interfaceid": "dfb1522a-a9f7-4307-aa00-6466121817ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG os_vif [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfb1522a-a9, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5101b783-4590-4009-831d-44ebd5109059) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:04 user nova-compute[74441]: INFO os_vif [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:dc:d3,bridge_name='br-int',has_traffic_filtering=True,id=dfb1522a-a9f7-4307-aa00-6466121817ec,network=Network(4e9da287-72d8-480e-9136-5a67d56f7c5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfb1522a-a9')
Nov 09 01:18:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Deleting instance files /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54_del
Nov 09 01:18:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Deletion of /opt/stack/data/nova/instances/6a246a92-0eb4-4065-b4d2-d3b8b15f3f54_del complete
Nov 09 01:18:04 user nova-compute[74441]: INFO nova.compute.manager [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 09 01:18:04 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:18:04 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-99da506f-9fbe-4678-8245-db56e476a79c req-4b0566b7-89f0-421a-b1f3-5509139d360a service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-vif-deleted-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:05 user nova-compute[74441]: INFO nova.compute.manager [req-99da506f-9fbe-4678-8245-db56e476a79c req-4b0566b7-89f0-421a-b1f3-5509139d360a service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Neutron deleted interface dfb1522a-a9f7-4307-aa00-6466121817ec; detaching it from the instance and deleting it from the info cache
Nov 09 01:18:05 user nova-compute[74441]: DEBUG nova.network.neutron [req-99da506f-9fbe-4678-8245-db56e476a79c req-4b0566b7-89f0-421a-b1f3-5509139d360a service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:18:05 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Took 0.81 seconds to deallocate network for instance.
Nov 09 01:18:05 user nova-compute[74441]: DEBUG nova.compute.manager [req-99da506f-9fbe-4678-8245-db56e476a79c req-4b0566b7-89f0-421a-b1f3-5509139d360a service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Detach interface failed, port_id=dfb1522a-a9f7-4307-aa00-6466121817ec, reason: Instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:18:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:05 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Deleted allocations for instance 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54
Nov 09 01:18:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-38a3c240-1065-4dbe-8500-cf5e2e4ed6f7 tempest-AttachVolumeTestJSON-1454008029 tempest-AttachVolumeTestJSON-1454008029-project-member] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-97241715-7659-4ac3-bf71-54ab0feabe9e req-e0aa65dc-24f9-4baa-a6a0-c4c45d6d6393 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received event network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-97241715-7659-4ac3-bf71-54ab0feabe9e req-e0aa65dc-24f9-4baa-a6a0-c4c45d6d6393 service nova] Acquiring lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-97241715-7659-4ac3-bf71-54ab0feabe9e req-e0aa65dc-24f9-4baa-a6a0-c4c45d6d6393 service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-97241715-7659-4ac3-bf71-54ab0feabe9e req-e0aa65dc-24f9-4baa-a6a0-c4c45d6d6393 service nova] Lock "6a246a92-0eb4-4065-b4d2-d3b8b15f3f54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-97241715-7659-4ac3-bf71-54ab0feabe9e req-e0aa65dc-24f9-4baa-a6a0-c4c45d6d6393 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] No waiting events found dispatching network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:18:06 user nova-compute[74441]: WARNING nova.compute.manager [req-97241715-7659-4ac3-bf71-54ab0feabe9e req-e0aa65dc-24f9-4baa-a6a0-c4c45d6d6393 service nova] [instance: 6a246a92-0eb4-4065-b4d2-d3b8b15f3f54] Received unexpected event network-vif-plugged-dfb1522a-a9f7-4307-aa00-6466121817ec for instance with vm_state deleted and task_state None.
Nov 09 01:18:09 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating instance_info_cache with network_info: [{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:18:09 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-changed-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Refreshing instance network info cache due to event network-changed-33b42049-0332-4a2a-b067-d3e715b8188c. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] Acquiring lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] Acquired lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Refreshing network info cache for port 33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:11 user nova-compute[74441]: INFO nova.compute.manager [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Terminating instance
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.compute.manager [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-37575108-cf4c-4e1d-9afa-ad7a7e79384a req-826f4ec5-66f1-49a4-a8f2-3618e35e9c48 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-vif-unplugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-37575108-cf4c-4e1d-9afa-ad7a7e79384a req-826f4ec5-66f1-49a4-a8f2-3618e35e9c48 service nova] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-37575108-cf4c-4e1d-9afa-ad7a7e79384a req-826f4ec5-66f1-49a4-a8f2-3618e35e9c48 service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-37575108-cf4c-4e1d-9afa-ad7a7e79384a req-826f4ec5-66f1-49a4-a8f2-3618e35e9c48 service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-37575108-cf4c-4e1d-9afa-ad7a7e79384a req-826f4ec5-66f1-49a4-a8f2-3618e35e9c48 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] No waiting events found dispatching network-vif-unplugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.compute.manager [req-37575108-cf4c-4e1d-9afa-ad7a7e79384a req-826f4ec5-66f1-49a4-a8f2-3618e35e9c48 service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-vif-unplugged-33b42049-0332-4a2a-b067-d3e715b8188c for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updated VIF entry in instance network info cache for port 33b42049-0332-4a2a-b067-d3e715b8188c. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG nova.network.neutron [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating instance_info_cache with network_info: [{"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-bc4ca2a1-8a54-407f-b085-b9b8497ff087 req-cc162da4-d574-4ff8-a890-7bf4e2e908cf service nova] Releasing lock "refresh_cache-0138f302-8a57-4060-b476-ff1d673fa02a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Instance destroyed successfully.
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'resources' on Instance uuid 0138f302-8a57-4060-b476-ff1d673fa02a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2097377907',display_name='tempest-TestStampPattern-server-2097377907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2097377907',id=46,image_ref='415afbc4-3c6e-4151-96cc-3a8af09c2a0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo7/pO4zSR1ADroCCg2eqYQ9pbvdCL5YyDK/eyYN9sApBRkwrLnAHtd5EEOhoWcsdQ5yZW+/68PtpdGs1Y/XPdTufNmckviqD07G4Xfbq1cpMUUyQzuCUmFoGCYG99Qng==',key_name='tempest-TestStampPattern-181357963',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8cfa05f08e4a99adff754a174b6e42',ramdisk_id='',reservation_id='r-08pr4478',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0558985f-65a5-49b7-8f2f-147dd3b029b8',image_min_disk='1',image_min_ram='0',image_owner_id='2c8cfa05f08e4a99adff754a174b6e42',image_owner_project_name='tempest-TestStampPattern-1784819717',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1784819717-project-member',image_user_id='96586584970e41a7be230fa812eee595',owner_project_name='tempest-TestStampPattern-1784819717',owner_user_name='tempest-TestStampPattern-1784819717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:14:52Z,user_data=None,user_id='96586584970e41a7be230fa812eee595',uuid=0138f302-8a57-4060-b476-ff1d673fa02a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converting VIF {"id": "33b42049-0332-4a2a-b067-d3e715b8188c", "address": "fa:16:3e:e3:da:c5", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33b42049-03", "ovs_interfaceid": "33b42049-0332-4a2a-b067-d3e715b8188c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG os_vif [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33b42049-03, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd5c3041-5383-4617-afa7-510db555d656) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:12 user nova-compute[74441]: INFO os_vif [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:da:c5,bridge_name='br-int',has_traffic_filtering=True,id=33b42049-0332-4a2a-b067-d3e715b8188c,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33b42049-03')
Nov 09 01:18:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Deleting instance files /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a_del
Nov 09 01:18:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Deletion of /opt/stack/data/nova/instances/0138f302-8a57-4060-b476-ff1d673fa02a_del complete
Nov 09 01:18:12 user nova-compute[74441]: INFO nova.compute.manager [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 01:18:12 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:18:12 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Took 0.54 seconds to deallocate network for instance.
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.compute.manager [req-37b0f87d-6599-45b3-a4a5-4f20c5934be5 req-7f275827-f844-4523-a6a7-6caeb58b06dd service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-vif-deleted-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:18:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:12 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Deleted allocations for instance 0138f302-8a57-4060-b476-ff1d673fa02a
Nov 09 01:18:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-2b72138b-be41-4805-aba6-3ca6888eb055 tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0138f302-8a57-4060-b476-ff1d673fa02a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-b38810a9-ad25-4681-9c80-54706157e635 req-dc43855f-4046-4cd2-b5f6-3f2fd83d0fad service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received event network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:18:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b38810a9-ad25-4681-9c80-54706157e635 req-dc43855f-4046-4cd2-b5f6-3f2fd83d0fad service nova] Acquiring lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b38810a9-ad25-4681-9c80-54706157e635 req-dc43855f-4046-4cd2-b5f6-3f2fd83d0fad service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b38810a9-ad25-4681-9c80-54706157e635 req-dc43855f-4046-4cd2-b5f6-3f2fd83d0fad service nova] Lock "0138f302-8a57-4060-b476-ff1d673fa02a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:13 user nova-compute[74441]: DEBUG nova.compute.manager [req-b38810a9-ad25-4681-9c80-54706157e635 req-dc43855f-4046-4cd2-b5f6-3f2fd83d0fad service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] No waiting events found dispatching network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:18:13 user nova-compute[74441]: WARNING nova.compute.manager [req-b38810a9-ad25-4681-9c80-54706157e635 req-dc43855f-4046-4cd2-b5f6-3f2fd83d0fad service nova] [instance: 0138f302-8a57-4060-b476-ff1d673fa02a] Received unexpected event network-vif-plugged-33b42049-0332-4a2a-b067-d3e715b8188c for instance with vm_state deleted and task_state None.
Nov 09 01:18:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:19 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:18:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:18:23 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:18:24 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:18:24 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=24.820560455322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 11cb1e64-ca68-49ca-8822-a265b841f00c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:18:24 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:18:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:26 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:18:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:18:45 user nova-compute[74441]: INFO nova.compute.manager [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Detaching volume 2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2
Nov 09 01:18:45 user nova-compute[74441]: INFO nova.virt.block_device [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Attempting to driver detach volume 2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 from mountpoint /dev/vdb
Nov 09 01:18:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Attempting to detach device vdb from instance 11cb1e64-ca68-49ca-8822-a265b841f00c from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:18:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:18:45 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:18:45 user nova-compute[74441]:   <source dev="/dev/sde"/>
Nov 09 01:18:45 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:18:45 user nova-compute[74441]:   <serial>2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2</serial>
Nov 09 01:18:45 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:18:45 user nova-compute[74441]: </disk>
Nov 09 01:18:45 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:18:45 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully detached device vdb from instance 11cb1e64-ca68-49ca-8822-a265b841f00c from the persistent domain config.
Nov 09 01:18:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11cb1e64-ca68-49ca-8822-a265b841f00c from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:18:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:18:45 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:18:45 user nova-compute[74441]:   <source dev="/dev/sde"/>
Nov 09 01:18:45 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:18:45 user nova-compute[74441]:   <serial>2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2</serial>
Nov 09 01:18:45 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:18:45 user nova-compute[74441]: </disk>
Nov 09 01:18:45 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:18:45 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:18:45 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11cb1e64-ca68-49ca-8822-a265b841f00c {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:18:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:18:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:18:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:05 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 11cb1e64-ca68-49ca-8822-a265b841f00c is timed out.
Nov 09 01:19:05 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully detached device vdb from instance 11cb1e64-ca68-49ca-8822-a265b841f00c from the live domain config.
Nov 09 01:19:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:19:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuqpStRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:19:05 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:19:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:19:05 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:19:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0db659f-9f86-480a-83f3-a1efd53c2994]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:19:06 user nova-compute[74441]: No targets found.
Nov 09 01:19:06 user nova-compute[74441]: iSNS:
Nov 09 01:19:06 user nova-compute[74441]: No targets found.
Nov 09 01:19:06 user nova-compute[74441]: STATIC:
Nov 09 01:19:06 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2
Nov 09 01:19:06 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:19:06 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:19:06 user nova-compute[74441]: FIRMWARE:
Nov 09 01:19:06 user nova-compute[74441]: No targets found.
Nov 09 01:19:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:19:06 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:19:06 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca76ee4-cbd6-47ae-a400-f35dbf995047]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b32d7-0047-477a-beb8-8de3cf3f4bf2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:19:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 (non-flash)
Nov 09 01:19:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f011c65d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2'): ({'sde'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Removing single pathed devices sde {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[86df447a-f03b-4f57-aeab-bc058489b626]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e60d3-8160-45b8-b65a-8ec1cdc0bf8c]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Flushing IO for device /dev/sde {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc3d7da-911b-4245-86e8-6740c815fcc3]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb11aacd-2f0b-4981-8c21-ce4cd8245b08]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] SCSI volumes sde have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b83d8-94ad-45ee-bb1b-107bbe642932]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7407900e-17fc-41e8-80fb-b72fb79a95cd]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260]
Nov 09 01:19:06 user nova-compute[74441]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2, portal: 172.16.0.220,3260] successful.
Nov 09 01:19:06 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a88e6ce-9034-44bf-8526-dc772dc15555]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== disconnect_volume: return (299ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:19:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:19:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:19:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:19:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Skipping network cache update for instance because it is being deleted. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 09 01:19:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:19:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:19:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:18 user nova-compute[74441]: DEBUG nova.objects.instance [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'flavor' on Instance uuid 11cb1e64-ca68-49ca-8822-a265b841f00c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-ae4a0466-d1b0-474f-abdf-8856799d25d3 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 33.603s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 33.487s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:19 user nova-compute[74441]: INFO nova.compute.manager [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Terminating instance
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.compute.manager [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-2605193c-a50b-48aa-a93a-8a5cd8192090 req-4eddb1ec-1dcb-4d4b-a31c-161a2918aa5d service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-vif-unplugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2605193c-a50b-48aa-a93a-8a5cd8192090 req-4eddb1ec-1dcb-4d4b-a31c-161a2918aa5d service nova] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2605193c-a50b-48aa-a93a-8a5cd8192090 req-4eddb1ec-1dcb-4d4b-a31c-161a2918aa5d service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-2605193c-a50b-48aa-a93a-8a5cd8192090 req-4eddb1ec-1dcb-4d4b-a31c-161a2918aa5d service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-2605193c-a50b-48aa-a93a-8a5cd8192090 req-4eddb1ec-1dcb-4d4b-a31c-161a2918aa5d service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] No waiting events found dispatching network-vif-unplugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.compute.manager [req-2605193c-a50b-48aa-a93a-8a5cd8192090 req-4eddb1ec-1dcb-4d4b-a31c-161a2918aa5d service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-vif-unplugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Instance destroyed successfully.
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'resources' on Instance uuid 11cb1e64-ca68-49ca-8822-a265b841f00c {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:15:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-14644821',display_name='tempest-VolumesSnapshotTestJSON-instance-14644821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-14644821',id=47,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/+5mwdc75QhLA/dj1/GtqgZU3lZ8UPzLV4hXnM47PsTJeODm3A78iAsbJp4aB/QzX0kZYYpqj8nNfYL7p3ZdZVC0NKJrMxiCArec8rbkhhaZRcFl8LsFF7P9/6+ZEPJw==',key_name='tempest-keypair-230901055',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:15:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d03e0c073f84374b26f1a05026c5276',ramdisk_id='',reservation_id='r-fnl0oboz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1971652422',owner_user_name='tempest-VolumesSnapshotTestJSON-1971652422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:15:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8703ed5948ee40e19421b1e2712e99a7',uuid=11cb1e64-ca68-49ca-8822-a265b841f00c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converting VIF {"id": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "address": "fa:16:3e:91:38:31", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5817b56c-a2", "ovs_interfaceid": "5817b56c-a24e-4d6f-82d2-83c9931a9f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_vif [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5817b56c-a2, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b22ba83c-11fa-45c1-befd-edbc141722e9) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:19 user nova-compute[74441]: INFO os_vif [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:38:31,bridge_name='br-int',has_traffic_filtering=True,id=5817b56c-a24e-4d6f-82d2-83c9931a9f52,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5817b56c-a2')
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:2dbb8779-b5b9-4659-9ab2-b9bb695cbfb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuqpStRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:19:19 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[57dbd1c9-1fbe-4dfb-994d-90cead6c006a]: Unexpected error while running command.
Nov 09 01:19:19 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:19:19 user nova-compute[74441]: Exit code: 21
Nov 09 01:19:19 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:19:19 user nova-compute[74441]: Stderr: '' {{(pid=85292) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 09 01:19:19 user nova-compute[74441]: Traceback (most recent call last):
Nov 09 01:19:19 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 09 01:19:19 user nova-compute[74441]:     ret = func(*f_args, **f_kwargs)
Nov 09 01:19:19 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 09 01:19:19 user nova-compute[74441]:     return func(*args, **kwargs)
Nov 09 01:19:19 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 09 01:19:19 user nova-compute[74441]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 09 01:19:19 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 09 01:19:19 user nova-compute[74441]:     return putils.execute(on_execute=on_execute,
Nov 09 01:19:19 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 09 01:19:19 user nova-compute[74441]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 09 01:19:19 user nova-compute[74441]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 01:19:19 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:19:19 user nova-compute[74441]: Exit code: 21
Nov 09 01:19:19 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:19:19 user nova-compute[74441]: Stderr: ''
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dbd1c9-1fbe-4dfb-994d-90cead6c006a]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 01:19:19 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:19:19 user nova-compute[74441]: Exit code: 21
Nov 09 01:19:19 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:19:19 user nova-compute[74441]: Stderr: ''
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 09 01:19:19 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74441) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== disconnect_volume: return (27ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:19:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Deleting instance files /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c_del
Nov 09 01:19:19 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Deletion of /opt/stack/data/nova/instances/11cb1e64-ca68-49ca-8822-a265b841f00c_del complete
Nov 09 01:19:19 user nova-compute[74441]: INFO nova.compute.manager [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 09 01:19:19 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:19:19 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:19:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:20 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:19:20 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Took 1.03 seconds to deallocate network for instance.
Nov 09 01:19:21 user nova-compute[74441]: WARNING nova.volume.cinder [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Attachment 839128ce-6774-4a97-8c0d-7fddc278c2e2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 839128ce-6774-4a97-8c0d-7fddc278c2e2. (HTTP 404) (Request-ID: req-a3cd769e-e0d2-4da7-a17b-aac0bfdf9409)
Nov 09 01:19:21 user nova-compute[74441]: INFO nova.compute.manager [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Took 0.03 seconds to detach 1 volumes for instance.
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:21 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Deleted allocations for instance 11cb1e64-ca68-49ca-8822-a265b841f00c
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c9878b70-c83f-4835-9126-bf7abed342e0 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.346s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] Acquiring lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] Lock "11cb1e64-ca68-49ca-8822-a265b841f00c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] No waiting events found dispatching network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:19:21 user nova-compute[74441]: WARNING nova.compute.manager [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received unexpected event network-vif-plugged-5817b56c-a24e-4d6f-82d2-83c9931a9f52 for instance with vm_state deleted and task_state None.
Nov 09 01:19:21 user nova-compute[74441]: DEBUG nova.compute.manager [req-18a12d74-54fa-49ec-b7e7-b2da09b81953 req-a505b68d-996a-4c74-bb9e-14fdef98b8e3 service nova] [instance: 11cb1e64-ca68-49ca-8822-a265b841f00c] Received event network-vif-deleted-5817b56c-a24e-4d6f-82d2-83c9931a9f52 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:19:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:19:26 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:19:26 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=24.942825317382812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:19:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:28 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:19:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:30 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 01:19:30 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 01:19:32 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:19:35 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:35 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-changed-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG nova.compute.manager [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Refreshing instance network info cache due to event network-changed-96af8899-9fcd-4ad9-ac8d-f08f81e85f93. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] Acquiring lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] Acquired lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG nova.network.neutron [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Refreshing network info cache for port 96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:36 user nova-compute[74441]: INFO nova.compute.manager [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Terminating instance
Nov 09 01:19:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updated VIF entry in instance network info cache for port 96af8899-9fcd-4ad9-ac8d-f08f81e85f93. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.network.neutron [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [{"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b7d57b9b-5e91-40d9-b2fe-edbb821060d9 req-ea4d3192-5961-4dbf-a595-5d683f9d9f84 service nova] Releasing lock "refresh_cache-0558985f-65a5-49b7-8f2f-147dd3b029b8" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:19:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Instance destroyed successfully.
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.objects.instance [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lazy-loading 'resources' on Instance uuid 0558985f-65a5-49b7-8f2f-147dd3b029b8 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:11:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-220303619',display_name='tempest-TestStampPattern-server-220303619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-220303619',id=44,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo7/pO4zSR1ADroCCg2eqYQ9pbvdCL5YyDK/eyYN9sApBRkwrLnAHtd5EEOhoWcsdQ5yZW+/68PtpdGs1Y/XPdTufNmckviqD07G4Xfbq1cpMUUyQzuCUmFoGCYG99Qng==',key_name='tempest-TestStampPattern-181357963',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8cfa05f08e4a99adff754a174b6e42',ramdisk_id='',reservation_id='r-32lpjpcw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1784819717',owner_user_name='tempest-TestStampPattern-1784819717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:14:43Z,user_data=None,user_id='96586584970e41a7be230fa812eee595',uuid=0558985f-65a5-49b7-8f2f-147dd3b029b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converting VIF {"id": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "address": "fa:16:3e:a2:33:2c", "network": {"id": "699edb33-88dc-4b74-9213-35de648eefdb", "bridge": "br-int", "label": "tempest-TestStampPattern-1617880183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8cfa05f08e4a99adff754a174b6e42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96af8899-9f", "ovs_interfaceid": "96af8899-9fcd-4ad9-ac8d-f08f81e85f93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG os_vif [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96af8899-9f, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d31b6dd4-9acd-478b-b48b-0ef753585686) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:19:37 user nova-compute[74441]: INFO os_vif [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:33:2c,bridge_name='br-int',has_traffic_filtering=True,id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93,network=Network(699edb33-88dc-4b74-9213-35de648eefdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96af8899-9f')
Nov 09 01:19:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Deleting instance files /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8_del
Nov 09 01:19:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Deletion of /opt/stack/data/nova/instances/0558985f-65a5-49b7-8f2f-147dd3b029b8_del complete
Nov 09 01:19:37 user nova-compute[74441]: INFO nova.compute.manager [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 01:19:37 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:19:37 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-12bb32f1-8feb-4f3d-85ec-6d8813433b6f req-cc7c70f9-8753-4d1a-ab84-15be612686cf service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-vif-deleted-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:38 user nova-compute[74441]: INFO nova.compute.manager [req-12bb32f1-8feb-4f3d-85ec-6d8813433b6f req-cc7c70f9-8753-4d1a-ab84-15be612686cf service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Neutron deleted interface 96af8899-9fcd-4ad9-ac8d-f08f81e85f93; detaching it from the instance and deleting it from the info cache
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.network.neutron [req-12bb32f1-8feb-4f3d-85ec-6d8813433b6f req-cc7c70f9-8753-4d1a-ab84-15be612686cf service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:19:38 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Took 0.94 seconds to deallocate network for instance.
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-12bb32f1-8feb-4f3d-85ec-6d8813433b6f req-cc7c70f9-8753-4d1a-ab84-15be612686cf service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Detach interface failed, port_id=96af8899-9fcd-4ad9-ac8d-f08f81e85f93, reason: Instance 0558985f-65a5-49b7-8f2f-147dd3b029b8 could not be found. {{(pid=74441) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-vif-unplugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] No waiting events found dispatching network-vif-unplugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:19:38 user nova-compute[74441]: WARNING nova.compute.manager [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received unexpected event network-vif-unplugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 for instance with vm_state deleted and task_state None.
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received event network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] Acquiring lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] No waiting events found dispatching network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:19:38 user nova-compute[74441]: WARNING nova.compute.manager [req-29f4c019-b217-4ed4-a6dc-791639d8a2e3 req-777d2529-d4cf-46b0-96b9-c1fbbc82cb91 service nova] [instance: 0558985f-65a5-49b7-8f2f-147dd3b029b8] Received unexpected event network-vif-plugged-96af8899-9fcd-4ad9-ac8d-f08f81e85f93 for instance with vm_state deleted and task_state None.
Nov 09 01:19:38 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:38 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Deleted allocations for instance 0558985f-65a5-49b7-8f2f-147dd3b029b8
Nov 09 01:19:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-a8f40b33-67bb-4b36-845a-c42f7752779e tempest-TestStampPattern-1784819717 tempest-TestStampPattern-1784819717-project-member] Lock "0558985f-65a5-49b7-8f2f-147dd3b029b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:19:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:19:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:19:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:20:04 user nova-compute[74441]: INFO nova.compute.claims [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Claim successful on node user
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.network.neutron [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:20:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.policy [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1768e99d61d545f6833920ec7511ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0991b909c4c009db61cdb6aa56910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:20:04 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Creating image(s)
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "/opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "/opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "/opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:04 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.201s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.200s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk 1073741824" returned: 0 in 0.056s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG nova.network.neutron [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Successfully created port: fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.193s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Cannot resize image /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Ensure instance console log exists: /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:05 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Successfully updated port: fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquired lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-changed-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Refreshing instance network info cache due to event network-changed-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] Acquiring lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.neutron [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Updating instance_info_cache with network_info: [{"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Releasing lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Instance network_info: |[{"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] Acquired lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.neutron [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Refreshing network info cache for port fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Start _get_guest_xml network_info=[{"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:20:06 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:20:06 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-926395862',display_name='tempest-VolumesActionsTest-instance-926395862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-926395862',id=49,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff0991b909c4c009db61cdb6aa56910',ramdisk_id='',reservation_id='r-hge30prq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-79567891',owner_user_name='tempest-VolumesActionsTest-79567891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:20:05Z,user_data=None,user_id='1768e99d61d545f6833920ec7511ca69',uuid=d705a6f9-5423-4f21-abe5-6d01076b1323,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converting VIF {"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.objects.instance [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lazy-loading 'pci_devices' on Instance uuid d705a6f9-5423-4f21-abe5-6d01076b1323 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:20:06 user nova-compute[74441]:   <uuid>d705a6f9-5423-4f21-abe5-6d01076b1323</uuid>
Nov 09 01:20:06 user nova-compute[74441]:   <name>instance-00000031</name>
Nov 09 01:20:06 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:20:06 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:20:06 user nova-compute[74441]:   <metadata>
Nov 09 01:20:06 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:20:06 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:20:06 user nova-compute[74441]:       <nova:name>tempest-VolumesActionsTest-instance-926395862</nova:name>
Nov 09 01:20:06 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:20:06</nova:creationTime>
Nov 09 01:20:06 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:20:06 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:20:06 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:20:06 user nova-compute[74441]:       <nova:owner>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:user uuid="1768e99d61d545f6833920ec7511ca69">tempest-VolumesActionsTest-79567891-project-member</nova:user>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:project uuid="7ff0991b909c4c009db61cdb6aa56910">tempest-VolumesActionsTest-79567891</nova:project>
Nov 09 01:20:06 user nova-compute[74441]:       </nova:owner>
Nov 09 01:20:06 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:20:06 user nova-compute[74441]:       <nova:ports>
Nov 09 01:20:06 user nova-compute[74441]:         <nova:port uuid="fb3c0d37-27c3-48bd-82b4-4eaf1ec14186">
Nov 09 01:20:06 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 01:20:06 user nova-compute[74441]:         </nova:port>
Nov 09 01:20:06 user nova-compute[74441]:       </nova:ports>
Nov 09 01:20:06 user nova-compute[74441]:     </nova:instance>
Nov 09 01:20:06 user nova-compute[74441]:   </metadata>
Nov 09 01:20:06 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:20:06 user nova-compute[74441]:     <system>
Nov 09 01:20:06 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:20:06 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:20:06 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:20:06 user nova-compute[74441]:       <entry name="serial">d705a6f9-5423-4f21-abe5-6d01076b1323</entry>
Nov 09 01:20:06 user nova-compute[74441]:       <entry name="uuid">d705a6f9-5423-4f21-abe5-6d01076b1323</entry>
Nov 09 01:20:06 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:20:06 user nova-compute[74441]:     </system>
Nov 09 01:20:06 user nova-compute[74441]:   </sysinfo>
Nov 09 01:20:06 user nova-compute[74441]:   <os>
Nov 09 01:20:06 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:20:06 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:20:06 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:20:06 user nova-compute[74441]:   </os>
Nov 09 01:20:06 user nova-compute[74441]:   <features>
Nov 09 01:20:06 user nova-compute[74441]:     <acpi/>
Nov 09 01:20:06 user nova-compute[74441]:     <apic/>
Nov 09 01:20:06 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:20:06 user nova-compute[74441]:   </features>
Nov 09 01:20:06 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:20:06 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:20:06 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:20:06 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:20:06 user nova-compute[74441]:   </clock>
Nov 09 01:20:06 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:20:06 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:20:06 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:20:06 user nova-compute[74441]:   </cpu>
Nov 09 01:20:06 user nova-compute[74441]:   <devices>
Nov 09 01:20:06 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:20:06 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:20:06 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk"/>
Nov 09 01:20:06 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:20:06 user nova-compute[74441]:     </disk>
Nov 09 01:20:06 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:20:06 user nova-compute[74441]:       <mac address="fa:16:3e:96:bc:d5"/>
Nov 09 01:20:06 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:20:06 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:20:06 user nova-compute[74441]:       <target dev="tapfb3c0d37-27"/>
Nov 09 01:20:06 user nova-compute[74441]:     </interface>
Nov 09 01:20:06 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:20:06 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/console.log" append="off"/>
Nov 09 01:20:06 user nova-compute[74441]:     </serial>
Nov 09 01:20:06 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:20:06 user nova-compute[74441]:     <video>
Nov 09 01:20:06 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:20:06 user nova-compute[74441]:     </video>
Nov 09 01:20:06 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:20:06 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:20:06 user nova-compute[74441]:     </rng>
Nov 09 01:20:06 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:20:06 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:20:06 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:20:06 user nova-compute[74441]:     </memballoon>
Nov 09 01:20:06 user nova-compute[74441]:   </devices>
Nov 09 01:20:06 user nova-compute[74441]: </domain>
Nov 09 01:20:06 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-926395862',display_name='tempest-VolumesActionsTest-instance-926395862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-926395862',id=49,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff0991b909c4c009db61cdb6aa56910',ramdisk_id='',reservation_id='r-hge30prq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-79567891',owner_user_name='tempest-VolumesActionsTest-79567891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:20:05Z,user_data=None,user_id='1768e99d61d545f6833920ec7511ca69',uuid=d705a6f9-5423-4f21-abe5-6d01076b1323,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converting VIF {"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG os_vif [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25cfccb8-6d98-549e-bb95-cf91d81c6a18', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb3c0d37-27, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb3c0d37-27, col_values=(('qos', UUID('f41bd875-2b22-44f2-9de1-7f61b8d2cf65')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb3c0d37-27, col_values=(('external_ids', {'iface-id': 'fb3c0d37-27c3-48bd-82b4-4eaf1ec14186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:bc:d5', 'vm-uuid': 'd705a6f9-5423-4f21-abe5-6d01076b1323'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:06 user nova-compute[74441]: INFO os_vif [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27')
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:20:06 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] No VIF found with MAC fa:16:3e:96:bc:d5, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:20:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Updated VIF entry in instance network info cache for port fb3c0d37-27c3-48bd-82b4-4eaf1ec14186. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:20:07 user nova-compute[74441]: DEBUG nova.network.neutron [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Updating instance_info_cache with network_info: [{"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:20:07 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8cfc86e-42ad-46c5-a7b8-6c73465940e7 req-4e89df8c-2dc5-477a-99bd-10feff0e53ef service nova] Releasing lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-00858ec9-8f00-4b6f-9998-0c4fcab9a10e req-88bf61a9-794f-4542-8011-ad645d41ea88 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00858ec9-8f00-4b6f-9998-0c4fcab9a10e req-88bf61a9-794f-4542-8011-ad645d41ea88 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00858ec9-8f00-4b6f-9998-0c4fcab9a10e req-88bf61a9-794f-4542-8011-ad645d41ea88 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-00858ec9-8f00-4b6f-9998-0c4fcab9a10e req-88bf61a9-794f-4542-8011-ad645d41ea88 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG nova.compute.manager [req-00858ec9-8f00-4b6f-9998-0c4fcab9a10e req-88bf61a9-794f-4542-8011-ad645d41ea88 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:20:08 user nova-compute[74441]: WARNING nova.compute.manager [req-00858ec9-8f00-4b6f-9998-0c4fcab9a10e req-88bf61a9-794f-4542-8011-ad645d41ea88 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received unexpected event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with vm_state building and task_state spawning.
Nov 09 01:20:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Skipping network cache update for instance because it is Building. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:20:10 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Instance spawned successfully.
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-e2113a8b-50dc-454b-ba56-f8bcb8141134 req-41b0a1a5-a1f6-4ec6-b133-64f0fee8dbeb service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e2113a8b-50dc-454b-ba56-f8bcb8141134 req-41b0a1a5-a1f6-4ec6-b133-64f0fee8dbeb service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e2113a8b-50dc-454b-ba56-f8bcb8141134 req-41b0a1a5-a1f6-4ec6-b133-64f0fee8dbeb service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e2113a8b-50dc-454b-ba56-f8bcb8141134 req-41b0a1a5-a1f6-4ec6-b133-64f0fee8dbeb service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [req-e2113a8b-50dc-454b-ba56-f8bcb8141134 req-41b0a1a5-a1f6-4ec6-b133-64f0fee8dbeb service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:20:10 user nova-compute[74441]: WARNING nova.compute.manager [req-e2113a8b-50dc-454b-ba56-f8bcb8141134 req-41b0a1a5-a1f6-4ec6-b133-64f0fee8dbeb service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received unexpected event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with vm_state building and task_state spawning.
Nov 09 01:20:10 user nova-compute[74441]: INFO nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 09 01:20:10 user nova-compute[74441]: DEBUG nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:20:10 user nova-compute[74441]: INFO nova.compute.manager [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Took 6.24 seconds to build instance.
Nov 09 01:20:10 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-93f5efad-ad93-4c70-b84d-3d39bdc00cb1 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.336s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:11 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:16 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:21 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:23 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:26 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:20:26 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=24.932716369628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d705a6f9-5423-4f21-abe5-6d01076b1323 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:20:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:31 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:32 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:20:36 user nova-compute[74441]: INFO nova.compute.claims [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Claim successful on node user
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:20:36 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:36 user nova-compute[74441]: DEBUG nova.policy [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8703ed5948ee40e19421b1e2712e99a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d03e0c073f84374b26f1a05026c5276', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:20:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Creating image(s)
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "/opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "/opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.192s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.196s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk 1073741824" returned: 0 in 0.059s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Successfully created port: 1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.205s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Cannot resize image /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Ensure instance console log exists: /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Successfully updated port: 1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquired lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-changed-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.compute.manager [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Refreshing instance network info cache due to event network-changed-1b880f76-c548-43d0-b558-cc43792ee3f8. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] Acquiring lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating instance_info_cache with network_info: [{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Releasing lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Instance network_info: |[{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] Acquired lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.neutron [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Refreshing network info cache for port 1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Start _get_guest_xml network_info=[{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:20:38 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:20:38 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2004477295',display_name='tempest-VolumesSnapshotTestJSON-instance-2004477295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2004477295',id=50,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvBSamxxflk0u0i9sM6Z6hHdJxZWLX3RrN0YQwEojhEH7YWhORzulxNsvlNYgNrIIPdiaSqjJn9ov8TxiYrBOoMwm7B9ac43qY3IcbO2pY5hB/Jthn1Be15OutyV9OBww==',key_name='tempest-keypair-1932595544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d03e0c073f84374b26f1a05026c5276',ramdisk_id='',reservation_id='r-dgr370ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971652422',owner_user_name='tempest-VolumesSnapshotTestJSON-1971652422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8703ed5948ee40e19421b1e2712e99a7',uuid=b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converting VIF {"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'pci_devices' on Instance uuid b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:20:38 user nova-compute[74441]:   <uuid>b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a</uuid>
Nov 09 01:20:38 user nova-compute[74441]:   <name>instance-00000032</name>
Nov 09 01:20:38 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:20:38 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:20:38 user nova-compute[74441]:   <metadata>
Nov 09 01:20:38 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:20:38 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:20:38 user nova-compute[74441]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2004477295</nova:name>
Nov 09 01:20:38 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:20:38</nova:creationTime>
Nov 09 01:20:38 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:20:38 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:20:38 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:20:38 user nova-compute[74441]:       <nova:owner>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:user uuid="8703ed5948ee40e19421b1e2712e99a7">tempest-VolumesSnapshotTestJSON-1971652422-project-member</nova:user>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:project uuid="2d03e0c073f84374b26f1a05026c5276">tempest-VolumesSnapshotTestJSON-1971652422</nova:project>
Nov 09 01:20:38 user nova-compute[74441]:       </nova:owner>
Nov 09 01:20:38 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:20:38 user nova-compute[74441]:       <nova:ports>
Nov 09 01:20:38 user nova-compute[74441]:         <nova:port uuid="1b880f76-c548-43d0-b558-cc43792ee3f8">
Nov 09 01:20:38 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 01:20:38 user nova-compute[74441]:         </nova:port>
Nov 09 01:20:38 user nova-compute[74441]:       </nova:ports>
Nov 09 01:20:38 user nova-compute[74441]:     </nova:instance>
Nov 09 01:20:38 user nova-compute[74441]:   </metadata>
Nov 09 01:20:38 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:20:38 user nova-compute[74441]:     <system>
Nov 09 01:20:38 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:20:38 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:20:38 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:20:38 user nova-compute[74441]:       <entry name="serial">b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a</entry>
Nov 09 01:20:38 user nova-compute[74441]:       <entry name="uuid">b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a</entry>
Nov 09 01:20:38 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:20:38 user nova-compute[74441]:     </system>
Nov 09 01:20:38 user nova-compute[74441]:   </sysinfo>
Nov 09 01:20:38 user nova-compute[74441]:   <os>
Nov 09 01:20:38 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:20:38 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:20:38 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:20:38 user nova-compute[74441]:   </os>
Nov 09 01:20:38 user nova-compute[74441]:   <features>
Nov 09 01:20:38 user nova-compute[74441]:     <acpi/>
Nov 09 01:20:38 user nova-compute[74441]:     <apic/>
Nov 09 01:20:38 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:20:38 user nova-compute[74441]:   </features>
Nov 09 01:20:38 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:20:38 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:20:38 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:20:38 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:20:38 user nova-compute[74441]:   </clock>
Nov 09 01:20:38 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:20:38 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:20:38 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:20:38 user nova-compute[74441]:   </cpu>
Nov 09 01:20:38 user nova-compute[74441]:   <devices>
Nov 09 01:20:38 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:20:38 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:20:38 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk"/>
Nov 09 01:20:38 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:20:38 user nova-compute[74441]:     </disk>
Nov 09 01:20:38 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:20:38 user nova-compute[74441]:       <mac address="fa:16:3e:66:6c:83"/>
Nov 09 01:20:38 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:20:38 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:20:38 user nova-compute[74441]:       <target dev="tap1b880f76-c5"/>
Nov 09 01:20:38 user nova-compute[74441]:     </interface>
Nov 09 01:20:38 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:20:38 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/console.log" append="off"/>
Nov 09 01:20:38 user nova-compute[74441]:     </serial>
Nov 09 01:20:38 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:20:38 user nova-compute[74441]:     <video>
Nov 09 01:20:38 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:20:38 user nova-compute[74441]:     </video>
Nov 09 01:20:38 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:20:38 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:20:38 user nova-compute[74441]:     </rng>
Nov 09 01:20:38 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:20:38 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:20:38 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:20:38 user nova-compute[74441]:     </memballoon>
Nov 09 01:20:38 user nova-compute[74441]:   </devices>
Nov 09 01:20:38 user nova-compute[74441]: </domain>
Nov 09 01:20:38 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2004477295',display_name='tempest-VolumesSnapshotTestJSON-instance-2004477295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2004477295',id=50,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvBSamxxflk0u0i9sM6Z6hHdJxZWLX3RrN0YQwEojhEH7YWhORzulxNsvlNYgNrIIPdiaSqjJn9ov8TxiYrBOoMwm7B9ac43qY3IcbO2pY5hB/Jthn1Be15OutyV9OBww==',key_name='tempest-keypair-1932595544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d03e0c073f84374b26f1a05026c5276',ramdisk_id='',reservation_id='r-dgr370ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1971652422',owner_user_name='tempest-VolumesSnapshotTestJSON-1971652422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8703ed5948ee40e19421b1e2712e99a7',uuid=b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converting VIF {"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG os_vif [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e9c4aac-3af5-5924-8f63-271f0797c2ea', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b880f76-c5, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b880f76-c5, col_values=(('qos', UUID('d4e24716-c5cc-4d16-9d1e-f6ab87ad63a1')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b880f76-c5, col_values=(('external_ids', {'iface-id': '1b880f76-c548-43d0-b558-cc43792ee3f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:6c:83', 'vm-uuid': 'b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:38 user nova-compute[74441]: INFO os_vif [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5')
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:20:38 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No VIF found with MAC fa:16:3e:66:6c:83, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:20:39 user nova-compute[74441]: DEBUG nova.network.neutron [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updated VIF entry in instance network info cache for port 1b880f76-c548-43d0-b558-cc43792ee3f8. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:20:39 user nova-compute[74441]: DEBUG nova.network.neutron [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating instance_info_cache with network_info: [{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:20:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b038fe08-c196-44fd-945b-6fa4fb99d62c req-4ea75cb9-5094-4f64-9b63-8b867e0745b7 service nova] Releasing lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-4a55759a-9782-4448-9938-7d301de25637 req-7efab7d5-3f82-47f6-b6aa-e5199b82f304 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4a55759a-9782-4448-9938-7d301de25637 req-7efab7d5-3f82-47f6-b6aa-e5199b82f304 service nova] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4a55759a-9782-4448-9938-7d301de25637 req-7efab7d5-3f82-47f6-b6aa-e5199b82f304 service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-4a55759a-9782-4448-9938-7d301de25637 req-7efab7d5-3f82-47f6-b6aa-e5199b82f304 service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG nova.compute.manager [req-4a55759a-9782-4448-9938-7d301de25637 req-7efab7d5-3f82-47f6-b6aa-e5199b82f304 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] No waiting events found dispatching network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:20:40 user nova-compute[74441]: WARNING nova.compute.manager [req-4a55759a-9782-4448-9938-7d301de25637 req-7efab7d5-3f82-47f6-b6aa-e5199b82f304 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received unexpected event network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 for instance with vm_state building and task_state spawning.
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:41 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-a6bff7ba-d874-44e9-af42-bce412d914cd req-95bbf0b4-e0f6-4540-ad4f-d4848d14ccc6 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a6bff7ba-d874-44e9-af42-bce412d914cd req-95bbf0b4-e0f6-4540-ad4f-d4848d14ccc6 service nova] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a6bff7ba-d874-44e9-af42-bce412d914cd req-95bbf0b4-e0f6-4540-ad4f-d4848d14ccc6 service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-a6bff7ba-d874-44e9-af42-bce412d914cd req-95bbf0b4-e0f6-4540-ad4f-d4848d14ccc6 service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.compute.manager [req-a6bff7ba-d874-44e9-af42-bce412d914cd req-95bbf0b4-e0f6-4540-ad4f-d4848d14ccc6 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] No waiting events found dispatching network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:20:42 user nova-compute[74441]: WARNING nova.compute.manager [req-a6bff7ba-d874-44e9-af42-bce412d914cd req-95bbf0b4-e0f6-4540-ad4f-d4848d14ccc6 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received unexpected event network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 for instance with vm_state building and task_state spawning.
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:20:42 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Instance spawned successfully.
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:20:42 user nova-compute[74441]: INFO nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 09 01:20:42 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:20:42 user nova-compute[74441]: INFO nova.compute.manager [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Took 6.25 seconds to build instance.
Nov 09 01:20:42 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e176bfa1-c596-40c4-9218-360c622be3de tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:20:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:20:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:20:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:03 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid d705a6f9-5423-4f21-abe5-6d01076b1323 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Updating instance_info_cache with network_info: [{"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-d705a6f9-5423-4f21-abe5-6d01076b1323" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:21:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:21:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:20 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:21:25 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:21:26 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:21:26 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=24.899742126464844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance d705a6f9-5423-4f21-abe5-6d01076b1323 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:21:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:21:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:21:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:21:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:21:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:21:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:21:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:21:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:21:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:21:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:21:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:48 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:54 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:54 user nova-compute[74441]: INFO nova.compute.manager [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Terminating instance
Nov 09 01:21:54 user nova-compute[74441]: DEBUG nova.compute.manager [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-82242c53-ae8f-41a5-bab9-d5259f66d322 req-ad576823-470e-436f-a843-64e95de284f6 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-unplugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-82242c53-ae8f-41a5-bab9-d5259f66d322 req-ad576823-470e-436f-a843-64e95de284f6 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-82242c53-ae8f-41a5-bab9-d5259f66d322 req-ad576823-470e-436f-a843-64e95de284f6 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-82242c53-ae8f-41a5-bab9-d5259f66d322 req-ad576823-470e-436f-a843-64e95de284f6 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-82242c53-ae8f-41a5-bab9-d5259f66d322 req-ad576823-470e-436f-a843-64e95de284f6 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-unplugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.compute.manager [req-82242c53-ae8f-41a5-bab9-d5259f66d322 req-ad576823-470e-436f-a843-64e95de284f6 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-unplugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Instance destroyed successfully.
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.objects.instance [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lazy-loading 'resources' on Instance uuid d705a6f9-5423-4f21-abe5-6d01076b1323 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:20:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-926395862',display_name='tempest-VolumesActionsTest-instance-926395862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-926395862',id=49,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff0991b909c4c009db61cdb6aa56910',ramdisk_id='',reservation_id='r-hge30prq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-79567891',owner_user_name='tempest-VolumesActionsTest-79567891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:20:11Z,user_data=None,user_id='1768e99d61d545f6833920ec7511ca69',uuid=d705a6f9-5423-4f21-abe5-6d01076b1323,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converting VIF {"id": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "address": "fa:16:3e:96:bc:d5", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb3c0d37-27", "ovs_interfaceid": "fb3c0d37-27c3-48bd-82b4-4eaf1ec14186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG os_vif [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb3c0d37-27, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f41bd875-2b22-44f2-9de1-7f61b8d2cf65) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:21:55 user nova-compute[74441]: INFO os_vif [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:bc:d5,bridge_name='br-int',has_traffic_filtering=True,id=fb3c0d37-27c3-48bd-82b4-4eaf1ec14186,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb3c0d37-27')
Nov 09 01:21:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Deleting instance files /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323_del
Nov 09 01:21:55 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Deletion of /opt/stack/data/nova/instances/d705a6f9-5423-4f21-abe5-6d01076b1323_del complete
Nov 09 01:21:55 user nova-compute[74441]: INFO nova.compute.manager [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 09 01:21:55 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:21:55 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:21:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:56 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:21:57 user nova-compute[74441]: WARNING nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received unexpected event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with vm_state active and task_state deleting.
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:21:57 user nova-compute[74441]: WARNING nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received unexpected event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with vm_state active and task_state deleting.
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:21:57 user nova-compute[74441]: WARNING nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received unexpected event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with vm_state active and task_state deleting.
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-unplugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-unplugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.manager [req-c5d35af5-4704-4cdb-a644-745d2de48b94 req-c288e0dc-267f-460e-9ef0-3ef6a6787354 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-unplugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:21:57 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Took 1.76 seconds to deallocate network for instance.
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:21:57 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:57 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Deleted allocations for instance d705a6f9-5423-4f21-abe5-6d01076b1323
Nov 09 01:21:58 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-9e6e7e10-7431-4d97-b93a-8ef20ffc22b7 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.192s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-deleted-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:21:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] Acquiring lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:21:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:21:59 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] Lock "d705a6f9-5423-4f21-abe5-6d01076b1323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:21:59 user nova-compute[74441]: DEBUG nova.compute.manager [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] No waiting events found dispatching network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:21:59 user nova-compute[74441]: WARNING nova.compute.manager [req-c8e90344-669f-4985-a961-bd664edb9b53 req-19f2b558-3ddb-4d40-a05d-ea77300dc686 service nova] [instance: d705a6f9-5423-4f21-abe5-6d01076b1323] Received unexpected event network-vif-plugged-fb3c0d37-27c3-48bd-82b4-4eaf1ec14186 for instance with vm_state deleted and task_state None.
Nov 09 01:22:00 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:05 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:22:10 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating instance_info_cache with network_info: [{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:22:12 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:22:15 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:22:20 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:22:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:23 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:24 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:22:25 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:26 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:27 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:22:27 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8841MB free_disk=24.92615509033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-changed-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.compute.manager [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Refreshing instance network info cache due to event network-changed-1b880f76-c548-43d0-b558-cc43792ee3f8. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] Acquiring lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] Acquired lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Refreshing network info cache for port 1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'flavor' on Instance uuid b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:22:27 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Ignoring supplied device name: /dev/vdb
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updated VIF entry in instance network info cache for port 1b880f76-c548-43d0-b558-cc43792ee3f8. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG nova.network.neutron [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating instance_info_cache with network_info: [{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:22:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c3739e2e-6bd1-4f7c-93e1-37d9db98cd51 req-9b7e365e-6d7a-42b0-a8a7-9dc925306c9f service nova] Releasing lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:28 user nova-compute[74441]: INFO nova.compute.manager [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Attaching volume 98189f80-907c-46e4-92cb-98906ecff41f to /dev/vdb
Nov 09 01:22:28 user nova-compute[74441]: DEBUG os_brick.utils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ef4c32-1a4b-468a-bd43-2da083258241]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:19628543152\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce2d380-a0f2-422e-9a1a-f53e37660d02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d10a7f-6f86-4241-8851-10b9539b9bf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1758a19-2c8b-4b7e-8781-4182c1c2afa7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Running cmd (subprocess): nvme version {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] 'nvme version' failed. Not Retrying. {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] nvme not present on system {{(pid=74441) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:22:28 user nova-compute[74441]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 01:22:28 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8c3a45-7c06-4212-b83e-3dc4a2897e1d]: (4, '') {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74441) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.lightos [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] LIGHTOS: no hostnqn found. {{(pid=74441) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG os_brick.utils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:19628543152', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:22:28 user nova-compute[74441]: DEBUG nova.virt.block_device [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating existing volume attachment record: 5072bc69-5ba2-40af-baa9-77bc18126eab {{(pid=74441) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 01:22:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:30 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:32 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:33 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:35 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:35 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:38 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:39 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:22:40 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:43 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:45 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Starting instance... {{(pid=74441) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74441) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 01:22:46 user nova-compute[74441]: INFO nova.compute.claims [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Claim successful on node user
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Start building networks asynchronously for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Allocating IP information in the background. {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] allocate_for_instance() {{(pid=74441) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 01:22:46 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 01:22:46 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Start building block device mappings for instance. {{(pid=74441) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.policy [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1768e99d61d545f6833920ec7511ca69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ff0991b909c4c009db61cdb6aa56910', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74441) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Start spawning the instance on the hypervisor. {{(pid=74441) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Creating instance directory {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 01:22:47 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Creating image(s)
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "/opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "/opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.177s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.251s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk 1073741824 {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4,backing_fmt=raw /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk 1073741824" returned: 0 in 0.048s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "77726613366e27f1d9da7a0cca2ca3d139158fa4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Successfully created port: fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/77726613366e27f1d9da7a0cca2ca3d139158fa4 --force-share --output=json" returned: 0 in 0.197s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk. size=1073741824 {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.virt.disk.api [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Cannot resize image /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk to a smaller size. {{(pid=74441) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Created local disks {{(pid=74441) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Ensure instance console log exists: /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/console.log {{(pid=74441) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:47 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Successfully updated port: fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquired lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Building network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-changed-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.compute.manager [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Refreshing instance network info cache due to event network-changed-fce296bf-afc9-4efd-b839-d19ca3f3b55b. {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] Acquiring lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Instance cache missing network info. {{(pid=74441) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.network.neutron [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Updating instance_info_cache with network_info: [{"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Releasing lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Instance network_info: |[{"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74441) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] Acquired lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.network.neutron [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Refreshing network info cache for port fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Start _get_guest_xml network_info=[{"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '8bb75127-e2cb-4fc7-b1f7-8e01f3707323'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 01:22:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:22:48 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CPU controller missing on host. {{(pid=74441) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.host [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CPU controller found on host. {{(pid=74441) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74441) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T00:33:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T00:34:10Z,direct_url=<?>,disk_format='qcow2',id=8bb75127-e2cb-4fc7-b1f7-8e01f3707323,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='40527f15127d4f1e8218ed81766fc497',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T00:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Flavor limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Image limits 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Flavor pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Image pref 0:0:0 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Got 1 possible topologies {{(pid=74441) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 01:22:48 user nova-compute[74441]: DEBUG nova.virt.hardware [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74441) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1073292047',display_name='tempest-VolumesActionsTest-instance-1073292047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1073292047',id=51,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff0991b909c4c009db61cdb6aa56910',ramdisk_id='',reservation_id='r-c1jqhkpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-79567891',owner_user_name='tempest-VolumesActionsTest-79567891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:22:47Z,user_data=None,user_id='1768e99d61d545f6833920ec7511ca69',uuid=b7aa8e3a-221b-4a44-86a8-fa8fd67af927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74441) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converting VIF {"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.objects.instance [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lazy-loading 'pci_devices' on Instance uuid b7aa8e3a-221b-4a44-86a8-fa8fd67af927 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] End _get_guest_xml xml=<domain type="kvm">
Nov 09 01:22:49 user nova-compute[74441]:   <uuid>b7aa8e3a-221b-4a44-86a8-fa8fd67af927</uuid>
Nov 09 01:22:49 user nova-compute[74441]:   <name>instance-00000033</name>
Nov 09 01:22:49 user nova-compute[74441]:   <memory>524288</memory>
Nov 09 01:22:49 user nova-compute[74441]:   <vcpu>1</vcpu>
Nov 09 01:22:49 user nova-compute[74441]:   <metadata>
Nov 09 01:22:49 user nova-compute[74441]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 01:22:49 user nova-compute[74441]:       <nova:package version="0.0.0"/>
Nov 09 01:22:49 user nova-compute[74441]:       <nova:name>tempest-VolumesActionsTest-instance-1073292047</nova:name>
Nov 09 01:22:49 user nova-compute[74441]:       <nova:creationTime>2023-11-09 01:22:48</nova:creationTime>
Nov 09 01:22:49 user nova-compute[74441]:       <nova:flavor name="m1.tiny">
Nov 09 01:22:49 user nova-compute[74441]:         <nova:memory>512</nova:memory>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:disk>1</nova:disk>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:swap>0</nova:swap>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:vcpus>1</nova:vcpus>
Nov 09 01:22:49 user nova-compute[74441]:       </nova:flavor>
Nov 09 01:22:49 user nova-compute[74441]:       <nova:owner>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:user uuid="1768e99d61d545f6833920ec7511ca69">tempest-VolumesActionsTest-79567891-project-member</nova:user>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:project uuid="7ff0991b909c4c009db61cdb6aa56910">tempest-VolumesActionsTest-79567891</nova:project>
Nov 09 01:22:49 user nova-compute[74441]:       </nova:owner>
Nov 09 01:22:49 user nova-compute[74441]:       <nova:root type="image" uuid="8bb75127-e2cb-4fc7-b1f7-8e01f3707323"/>
Nov 09 01:22:49 user nova-compute[74441]:       <nova:ports>
Nov 09 01:22:49 user nova-compute[74441]:         <nova:port uuid="fce296bf-afc9-4efd-b839-d19ca3f3b55b">
Nov 09 01:22:49 user nova-compute[74441]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 01:22:49 user nova-compute[74441]:         </nova:port>
Nov 09 01:22:49 user nova-compute[74441]:       </nova:ports>
Nov 09 01:22:49 user nova-compute[74441]:     </nova:instance>
Nov 09 01:22:49 user nova-compute[74441]:   </metadata>
Nov 09 01:22:49 user nova-compute[74441]:   <sysinfo type="smbios">
Nov 09 01:22:49 user nova-compute[74441]:     <system>
Nov 09 01:22:49 user nova-compute[74441]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 01:22:49 user nova-compute[74441]:       <entry name="product">OpenStack Nova</entry>
Nov 09 01:22:49 user nova-compute[74441]:       <entry name="version">0.0.0</entry>
Nov 09 01:22:49 user nova-compute[74441]:       <entry name="serial">b7aa8e3a-221b-4a44-86a8-fa8fd67af927</entry>
Nov 09 01:22:49 user nova-compute[74441]:       <entry name="uuid">b7aa8e3a-221b-4a44-86a8-fa8fd67af927</entry>
Nov 09 01:22:49 user nova-compute[74441]:       <entry name="family">Virtual Machine</entry>
Nov 09 01:22:49 user nova-compute[74441]:     </system>
Nov 09 01:22:49 user nova-compute[74441]:   </sysinfo>
Nov 09 01:22:49 user nova-compute[74441]:   <os>
Nov 09 01:22:49 user nova-compute[74441]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 01:22:49 user nova-compute[74441]:     <boot dev="hd"/>
Nov 09 01:22:49 user nova-compute[74441]:     <smbios mode="sysinfo"/>
Nov 09 01:22:49 user nova-compute[74441]:   </os>
Nov 09 01:22:49 user nova-compute[74441]:   <features>
Nov 09 01:22:49 user nova-compute[74441]:     <acpi/>
Nov 09 01:22:49 user nova-compute[74441]:     <apic/>
Nov 09 01:22:49 user nova-compute[74441]:     <vmcoreinfo/>
Nov 09 01:22:49 user nova-compute[74441]:   </features>
Nov 09 01:22:49 user nova-compute[74441]:   <clock offset="utc">
Nov 09 01:22:49 user nova-compute[74441]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 01:22:49 user nova-compute[74441]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 01:22:49 user nova-compute[74441]:     <timer name="hpet" present="no"/>
Nov 09 01:22:49 user nova-compute[74441]:   </clock>
Nov 09 01:22:49 user nova-compute[74441]:   <cpu mode="custom" match="exact">
Nov 09 01:22:49 user nova-compute[74441]:     <model>Nehalem</model>
Nov 09 01:22:49 user nova-compute[74441]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 01:22:49 user nova-compute[74441]:   </cpu>
Nov 09 01:22:49 user nova-compute[74441]:   <devices>
Nov 09 01:22:49 user nova-compute[74441]:     <disk type="file" device="disk">
Nov 09 01:22:49 user nova-compute[74441]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 01:22:49 user nova-compute[74441]:       <source file="/opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk"/>
Nov 09 01:22:49 user nova-compute[74441]:       <target dev="vda" bus="virtio"/>
Nov 09 01:22:49 user nova-compute[74441]:     </disk>
Nov 09 01:22:49 user nova-compute[74441]:     <interface type="ethernet">
Nov 09 01:22:49 user nova-compute[74441]:       <mac address="fa:16:3e:69:93:5c"/>
Nov 09 01:22:49 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:22:49 user nova-compute[74441]:       <mtu size="1442"/>
Nov 09 01:22:49 user nova-compute[74441]:       <target dev="tapfce296bf-af"/>
Nov 09 01:22:49 user nova-compute[74441]:     </interface>
Nov 09 01:22:49 user nova-compute[74441]:     <serial type="pty">
Nov 09 01:22:49 user nova-compute[74441]:       <log file="/opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/console.log" append="off"/>
Nov 09 01:22:49 user nova-compute[74441]:     </serial>
Nov 09 01:22:49 user nova-compute[74441]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 01:22:49 user nova-compute[74441]:     <video>
Nov 09 01:22:49 user nova-compute[74441]:       <model type="virtio"/>
Nov 09 01:22:49 user nova-compute[74441]:     </video>
Nov 09 01:22:49 user nova-compute[74441]:     <rng model="virtio">
Nov 09 01:22:49 user nova-compute[74441]:       <backend model="random">/dev/urandom</backend>
Nov 09 01:22:49 user nova-compute[74441]:     </rng>
Nov 09 01:22:49 user nova-compute[74441]:     <controller type="usb" index="0" model="none"/>
Nov 09 01:22:49 user nova-compute[74441]:     <memballoon model="virtio">
Nov 09 01:22:49 user nova-compute[74441]:       <stats period="10"/>
Nov 09 01:22:49 user nova-compute[74441]:     </memballoon>
Nov 09 01:22:49 user nova-compute[74441]:   </devices>
Nov 09 01:22:49 user nova-compute[74441]: </domain>
Nov 09 01:22:49 user nova-compute[74441]:  {{(pid=74441) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1073292047',display_name='tempest-VolumesActionsTest-instance-1073292047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1073292047',id=51,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ff0991b909c4c009db61cdb6aa56910',ramdisk_id='',reservation_id='r-c1jqhkpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-79567891',owner_user_name='tempest-VolumesActionsTest-79567891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T01:22:47Z,user_data=None,user_id='1768e99d61d545f6833920ec7511ca69',uuid=b7aa8e3a-221b-4a44-86a8-fa8fd67af927,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converting VIF {"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG os_vif [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af') {{(pid=74441) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8df026c-52ae-5b58-878f-e9610285a685', '_type': 'linux-noop'}}, row=False) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfce296bf-af, may_exist=True, interface_attrs={}) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfce296bf-af, col_values=(('qos', UUID('aa55b72b-af95-4c2d-a1d4-84d6cdff9605')),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfce296bf-af, col_values=(('external_ids', {'iface-id': 'fce296bf-afc9-4efd-b839-d19ca3f3b55b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:93:5c', 'vm-uuid': 'b7aa8e3a-221b-4a44-86a8-fa8fd67af927'}),), if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:49 user nova-compute[74441]: INFO os_vif [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af')
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] No VIF found with MAC fa:16:3e:69:93:5c, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.network.neutron [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Updated VIF entry in instance network info cache for port fce296bf-afc9-4efd-b839-d19ca3f3b55b. {{(pid=74441) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG nova.network.neutron [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Updating instance_info_cache with network_info: [{"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:22:49 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-b4c04515-62c8-42ec-9b72-88382ac54cfb req-25995e19-5082-4feb-8693-2e9bee6bfe26 service nova] Releasing lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Calling os-brick to attach iSCSI Volume {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOTtYsnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:22:50 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:22:50 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:22:50 user nova-compute[74441]: INFO os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-103f55e5-f157-40d9-8b8f-025ef1413499 req-440c7b92-06cd-4341-956e-1d25d215b4c4 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-103f55e5-f157-40d9-8b8f-025ef1413499 req-440c7b92-06cd-4341-956e-1d25d215b4c4 service nova] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-103f55e5-f157-40d9-8b8f-025ef1413499 req-440c7b92-06cd-4341-956e-1d25d215b4c4 service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-103f55e5-f157-40d9-8b8f-025ef1413499 req-440c7b92-06cd-4341-956e-1d25d215b4c4 service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG nova.compute.manager [req-103f55e5-f157-40d9-8b8f-025ef1413499 req-440c7b92-06cd-4341-956e-1d25d215b4c4 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] No waiting events found dispatching network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:22:50 user nova-compute[74441]: WARNING nova.compute.manager [req-103f55e5-f157-40d9-8b8f-025ef1413499 req-440c7b92-06cd-4341-956e-1d25d215b4c4 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received unexpected event network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b for instance with vm_state building and task_state spawning.
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abc728b-a314-4cb4-b49b-e2ff958ed4e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 01:22:50 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --interface default --op new {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b246f7fc-3dee-4a0b-8161-1005454b0f89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f] added\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f] added
Nov 09 01:22:50 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d54d6-e6e3-43db-bea2-660818343c64]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce68ca7b-12e1-4254-a6b0-ac5ce835e701]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOTtYsnZ {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOTtYsnZ" returned: 0 in 0.017s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca773c6-437e-407f-8fb9-28825776e2de]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NOTtYsnZ'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[08acafc3-3dc3-4fd5-8746-ed3ec6a13d21]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7445015-e719-450e-bcf0-276976600dc3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 01:22:50 user nova-compute[74441]:  {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:22:50 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 01:22:50 user nova-compute[74441]:  {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:22:50 user nova-compute[74441]: WARNING os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 01:22:50 user nova-compute[74441]: 
Nov 09 01:22:50 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --login {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203628d-1063-42c8-96df-c5c495374488]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260]
Nov 09 01:22:51 user nova-compute[74441]: Login to [iface: default, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260] successful.
Nov 09 01:22:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbf5361-b3f7-416d-9030-cf703e4db8e7]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0332117-e2f3-466b-81d1-784e87dc4549]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f (non-flash)
Nov 09 01:22:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f (non-flash)
Nov 09 01:22:51 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Connected to 172.16.0.220:3260 {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74441) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74441) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e2c52e-e385-4c47-a798-efda88f78957]: (4, ('- - 0', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74441) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 01:22:51 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOTtYsnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74441) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23834646435313765', 'path': '/dev/sdb'} {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834646435313765', 'path': '/dev/sdb'} {{(pid=74441) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.objects.instance [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'flavor' on Instance uuid b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 01:22:52 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:22:52 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:22:52 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:22:52 user nova-compute[74441]:   <serial>98189f80-907c-46e4-92cb-98906ecff41f</serial>
Nov 09 01:22:52 user nova-compute[74441]: </disk>
Nov 09 01:22:52 user nova-compute[74441]:  {{(pid=74441) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Instance event wait completed in 0 seconds for  {{(pid=74441) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Guest created on hypervisor {{(pid=74441) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 01:22:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Instance spawned successfully.
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Found default for hw_cdrom_bus of ide {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Found default for hw_disk_bus of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Found default for hw_input_bus of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Found default for hw_pointer_model of None {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Found default for hw_video_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Found default for hw_vif_model of virtio {{(pid=74441) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74441) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] No VIF found with MAC fa:16:3e:66:6c:83, not building metadata {{(pid=74441) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 01:22:52 user nova-compute[74441]: INFO nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Checking state {{(pid=74441) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-c749615a-903e-41f7-a8c8-f5db68384281 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.043s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:52 user nova-compute[74441]: INFO nova.compute.manager [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Took 6.19 seconds to build instance.
Nov 09 01:22:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-e24d2811-23a2-4dc8-8dcf-8cb768eb9617 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.375s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-d60a8794-8872-4d7f-9f9d-a8e6e828ccfe req-d4334326-3145-44ab-b3a1-a76627c14d6e service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d60a8794-8872-4d7f-9f9d-a8e6e828ccfe req-d4334326-3145-44ab-b3a1-a76627c14d6e service nova] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d60a8794-8872-4d7f-9f9d-a8e6e828ccfe req-d4334326-3145-44ab-b3a1-a76627c14d6e service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d60a8794-8872-4d7f-9f9d-a8e6e828ccfe req-d4334326-3145-44ab-b3a1-a76627c14d6e service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:22:52 user nova-compute[74441]: DEBUG nova.compute.manager [req-d60a8794-8872-4d7f-9f9d-a8e6e828ccfe req-d4334326-3145-44ab-b3a1-a76627c14d6e service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] No waiting events found dispatching network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:22:52 user nova-compute[74441]: WARNING nova.compute.manager [req-d60a8794-8872-4d7f-9f9d-a8e6e828ccfe req-d4334326-3145-44ab-b3a1-a76627c14d6e service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received unexpected event network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b for instance with vm_state active and task_state None.
Nov 09 01:22:53 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:58 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:22:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:23:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:23:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:08 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG nova.objects.instance [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lazy-loading 'info_cache' on Instance uuid b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating instance_info_cache with network_info: [{"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:23:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:18 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:21 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:23:27 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74441) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 01:23:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:23:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=24.888076782226562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b7aa8e3a-221b-4a44-86a8-fa8fd67af927 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:23:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:36 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:23:39 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:23:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:23:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:44 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:23:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:23:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:49 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:23:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:23:52 user nova-compute[74441]: INFO nova.compute.manager [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Detaching volume 98189f80-907c-46e4-92cb-98906ecff41f
Nov 09 01:23:52 user nova-compute[74441]: INFO nova.virt.block_device [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Attempting to driver detach volume 98189f80-907c-46e4-92cb-98906ecff41f from mountpoint /dev/vdb
Nov 09 01:23:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Attempting to detach device vdb from instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a from the persistent domain config. {{(pid=74441) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 01:23:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:23:52 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:23:52 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:23:52 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:23:52 user nova-compute[74441]:   <serial>98189f80-907c-46e4-92cb-98906ecff41f</serial>
Nov 09 01:23:52 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:23:52 user nova-compute[74441]: </disk>
Nov 09 01:23:52 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:23:52 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully detached device vdb from instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a from the persistent domain config.
Nov 09 01:23:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a from the live domain config. {{(pid=74441) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 01:23:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.guest [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 01:23:52 user nova-compute[74441]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 01:23:52 user nova-compute[74441]:   <source dev="/dev/sdb"/>
Nov 09 01:23:52 user nova-compute[74441]:   <target dev="vdb" bus="virtio"/>
Nov 09 01:23:52 user nova-compute[74441]:   <serial>98189f80-907c-46e4-92cb-98906ecff41f</serial>
Nov 09 01:23:52 user nova-compute[74441]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 01:23:52 user nova-compute[74441]: </disk>
Nov 09 01:23:52 user nova-compute[74441]:  {{(pid=74441) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 01:23:52 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:23:52 user nova-compute[74441]: DEBUG nova.virt.libvirt.driver [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 01:23:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:23:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:23:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:23:54 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:23:59 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:24:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:24:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:24:04 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:24:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:24:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:24:09 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:12 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a is timed out.
Nov 09 01:24:12 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully detached device vdb from instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a from the live domain config.
Nov 09 01:24:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOTtYsnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:24:12 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e851eb1-dcfd-4819-8d12-d0e1bf93303e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 01:24:12 user nova-compute[74441]: No targets found.
Nov 09 01:24:12 user nova-compute[74441]: iSNS:
Nov 09 01:24:12 user nova-compute[74441]: No targets found.
Nov 09 01:24:12 user nova-compute[74441]: STATIC:
Nov 09 01:24:12 user nova-compute[74441]: Target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f
Nov 09 01:24:12 user nova-compute[74441]:         Portal: 172.16.0.220:3260,-1
Nov 09 01:24:12 user nova-compute[74441]:                 Iface Name: default
Nov 09 01:24:12 user nova-compute[74441]: FIRMWARE:
Nov 09 01:24:12 user nova-compute[74441]: No targets found.
Nov 09 01:24:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 01:24:12 user nova-compute[74441]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 01:24:12 user nova-compute[74441]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74441) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f', 0)] {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6191767-b565-4c12-a298-d318287d2d09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[12066230-f567-4671-b217-a47713617811]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f (non-flash)\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f (non-flash)
Nov 09 01:24:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f (non-flash)
Nov 09 01:24:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f014410ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f'): ({'sdb'}, set())}) {{(pid=74441) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Removing single pathed devices sdb {{(pid=74441) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6c441d-d2c4-49e4-bf79-0914a3b3c68b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e77f263-ffa8-436e-a5d4-19fa5c89fcdd]: (4, ('ok\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Flushing IO for device /dev/sdb {{(pid=74441) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e7017-4f3f-4a15-a5c8-718124f2e3f1]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74441) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2758459-fa0e-4356-b8c6-671e7a8c00dd]: (4, ('1', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.linuxscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] SCSI volumes sdb have been removed. {{(pid=74441) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f')] {{(pid=74441) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[d176e6f6-fe31-4e1e-97fa-d288cae6a59b]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --logout {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703a1a1-03cf-4148-af90-d72802f3de27]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260]
Nov 09 01:24:12 user nova-compute[74441]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f, portal: 172.16.0.220,3260] successful.
Nov 09 01:24:12 user nova-compute[74441]:  stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op delete {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[5609861c-af39-4451-a26e-a11a196d5f7f]: (4, ('', '')) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74441) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== disconnect_volume: return (304ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:24:12 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquired lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Forcefully refreshing network info cache for instance {{(pid=74441) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG nova.network.neutron [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Updating instance_info_cache with network_info: [{"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Releasing lock "refresh_cache-b7aa8e3a-221b-4a44-86a8-fa8fd67af927" {{(pid=74441) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Updated the network info_cache for instance {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG nova.objects.instance [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'flavor' on Instance uuid b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-f8799247-8f20-4aab-8a6b-62da95c1e044 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.827s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.706s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:13 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:13 user nova-compute[74441]: INFO nova.compute.manager [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Terminating instance
Nov 09 01:24:13 user nova-compute[74441]: DEBUG nova.compute.manager [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-05327431-9d36-4d4e-80f1-a93342b0686a req-0fc5b228-7eac-4b3e-b1f8-c98df96a7eba service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-vif-unplugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-05327431-9d36-4d4e-80f1-a93342b0686a req-0fc5b228-7eac-4b3e-b1f8-c98df96a7eba service nova] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-05327431-9d36-4d4e-80f1-a93342b0686a req-0fc5b228-7eac-4b3e-b1f8-c98df96a7eba service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-05327431-9d36-4d4e-80f1-a93342b0686a req-0fc5b228-7eac-4b3e-b1f8-c98df96a7eba service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-05327431-9d36-4d4e-80f1-a93342b0686a req-0fc5b228-7eac-4b3e-b1f8-c98df96a7eba service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] No waiting events found dispatching network-vif-unplugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.compute.manager [req-05327431-9d36-4d4e-80f1-a93342b0686a req-0fc5b228-7eac-4b3e-b1f8-c98df96a7eba service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-vif-unplugged-1b880f76-c548-43d0-b558-cc43792ee3f8 for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Instance destroyed successfully.
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.objects.instance [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lazy-loading 'resources' on Instance uuid b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2004477295',display_name='tempest-VolumesSnapshotTestJSON-instance-2004477295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2004477295',id=50,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvBSamxxflk0u0i9sM6Z6hHdJxZWLX3RrN0YQwEojhEH7YWhORzulxNsvlNYgNrIIPdiaSqjJn9ov8TxiYrBOoMwm7B9ac43qY3IcbO2pY5hB/Jthn1Be15OutyV9OBww==',key_name='tempest-keypair-1932595544',keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:20:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d03e0c073f84374b26f1a05026c5276',ramdisk_id='',reservation_id='r-dgr370ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1971652422',owner_user_name='tempest-VolumesSnapshotTestJSON-1971652422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8703ed5948ee40e19421b1e2712e99a7',uuid=b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converting VIF {"id": "1b880f76-c548-43d0-b558-cc43792ee3f8", "address": "fa:16:3e:66:6c:83", "network": {"id": "6ff14710-7703-4281-9727-5297a445ebcf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1698304396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d03e0c073f84374b26f1a05026c5276", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b880f76-c5", "ovs_interfaceid": "1b880f76-c548-43d0-b558-cc43792ee3f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_vif [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b880f76-c5, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4e24716-c5cc-4d16-9d1e-f6ab87ad63a1) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:14 user nova-compute[74441]: INFO os_vif [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:6c:83,bridge_name='br-int',has_traffic_filtering=True,id=1b880f76-c548-43d0-b558-cc43792ee3f8,network=Network(6ff14710-7703-4281-9727-5297a445ebcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b880f76-c5')
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] calling os-brick to detach iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f013c6b7490>, {'target_iqn': 'iqn.2010-10.org.openstack:98189f80-907c-46e4-92cb-98906ecff41f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOTtYsnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 01:24:14 user nova-compute[74441]: WARNING os_brick.initiator.connectors.base [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[1d67c04b-954f-4f97-9e7a-9427f480d790]: Unexpected error while running command.
Nov 09 01:24:14 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:24:14 user nova-compute[74441]: Exit code: 21
Nov 09 01:24:14 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:24:14 user nova-compute[74441]: Stderr: '' {{(pid=85292) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 09 01:24:14 user nova-compute[74441]: Traceback (most recent call last):
Nov 09 01:24:14 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 09 01:24:14 user nova-compute[74441]:     ret = func(*f_args, **f_kwargs)
Nov 09 01:24:14 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 09 01:24:14 user nova-compute[74441]:     return func(*args, **kwargs)
Nov 09 01:24:14 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 09 01:24:14 user nova-compute[74441]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 09 01:24:14 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 09 01:24:14 user nova-compute[74441]:     return putils.execute(on_execute=on_execute,
Nov 09 01:24:14 user nova-compute[74441]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 09 01:24:14 user nova-compute[74441]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 09 01:24:14 user nova-compute[74441]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 01:24:14 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:24:14 user nova-compute[74441]: Exit code: 21
Nov 09 01:24:14 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:24:14 user nova-compute[74441]: Stderr: ''
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67c04b-954f-4f97-9e7a-9427f480d790]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85292) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 01:24:14 user nova-compute[74441]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:24:14 user nova-compute[74441]: Exit code: 21
Nov 09 01:24:14 user nova-compute[74441]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:24:14 user nova-compute[74441]: Stderr: ''
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 09 01:24:14 user nova-compute[74441]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74441) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.base [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.027s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] <== disconnect_volume: return (30ms) None {{(pid=74441) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Disconnected iSCSI Volume {{(pid=74441) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 01:24:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Deleting instance files /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a_del
Nov 09 01:24:14 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Deletion of /opt/stack/data/nova/instances/b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a_del complete
Nov 09 01:24:14 user nova-compute[74441]: INFO nova.compute.manager [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 09 01:24:14 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:24:14 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:24:15 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:24:15 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Took 0.77 seconds to deallocate network for instance.
Nov 09 01:24:15 user nova-compute[74441]: WARNING nova.volume.cinder [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Attachment 5072bc69-5ba2-40af-baa9-77bc18126eab does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5072bc69-5ba2-40af-baa9-77bc18126eab. (HTTP 404) (Request-ID: req-14fa688d-b263-470a-bf3d-27bd314306ae)
Nov 09 01:24:15 user nova-compute[74441]: INFO nova.compute.manager [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Took 0.03 seconds to detach 1 volumes for instance.
Nov 09 01:24:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:15 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:24:15 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:24:15 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:15 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Deleted allocations for instance b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a
Nov 09 01:24:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-3a0efc83-a6f7-4dd9-8dc6-7e1668f84b08 tempest-VolumesSnapshotTestJSON-1971652422 tempest-VolumesSnapshotTestJSON-1971652422-project-member] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:24:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] Acquiring lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:16 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] Lock "b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] No waiting events found dispatching network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:24:16 user nova-compute[74441]: WARNING nova.compute.manager [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received unexpected event network-vif-plugged-1b880f76-c548-43d0-b558-cc43792ee3f8 for instance with vm_state deleted and task_state None.
Nov 09 01:24:16 user nova-compute[74441]: DEBUG nova.compute.manager [req-e41ad56b-3e16-4976-ac9c-6a9792775532 req-129e9193-9657-40ea-9ad0-c72477c9dd57 service nova] [instance: b5f11a6d-a1c2-41ad-b2c6-97b608dddf9a] Received event network-vif-deleted-1b880f76-c548-43d0-b558-cc43792ee3f8 {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:24:19 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:24 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:25 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.processutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74441) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:24:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:24:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:24:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=24.91494369506836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Instance b7aa8e3a-221b-4a44-86a8-fa8fd67af927 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74441) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:29 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 01:24:31 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] There are 0 instances to clean {{(pid=74441) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 01:24:34 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:36 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:37 user nova-compute[74441]: INFO nova.compute.manager [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Terminating instance
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.compute.manager [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Start destroying the instance on the hypervisor. {{(pid=74441) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-c1924c5d-136e-491a-b2b8-d0eb679a7340 req-1b77828e-59b0-4e91-b6fe-2cbdc31afec5 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-vif-unplugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c1924c5d-136e-491a-b2b8-d0eb679a7340 req-1b77828e-59b0-4e91-b6fe-2cbdc31afec5 service nova] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c1924c5d-136e-491a-b2b8-d0eb679a7340 req-1b77828e-59b0-4e91-b6fe-2cbdc31afec5 service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-c1924c5d-136e-491a-b2b8-d0eb679a7340 req-1b77828e-59b0-4e91-b6fe-2cbdc31afec5 service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-c1924c5d-136e-491a-b2b8-d0eb679a7340 req-1b77828e-59b0-4e91-b6fe-2cbdc31afec5 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] No waiting events found dispatching network-vif-unplugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.compute.manager [req-c1924c5d-136e-491a-b2b8-d0eb679a7340 req-1b77828e-59b0-4e91-b6fe-2cbdc31afec5 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-vif-unplugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b for instance with task_state deleting. {{(pid=74441) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 01:24:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [-] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Instance destroyed successfully.
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.objects.instance [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lazy-loading 'resources' on Instance uuid b7aa8e3a-221b-4a44-86a8-fa8fd67af927 {{(pid=74441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.virt.libvirt.vif [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T01:22:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1073292047',display_name='tempest-VolumesActionsTest-instance-1073292047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1073292047',id=51,image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T01:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ff0991b909c4c009db61cdb6aa56910',ramdisk_id='',reservation_id='r-c1jqhkpn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bb75127-e2cb-4fc7-b1f7-8e01f3707323',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-79567891',owner_user_name='tempest-VolumesActionsTest-79567891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T01:22:53Z,user_data=None,user_id='1768e99d61d545f6833920ec7511ca69',uuid=b7aa8e3a-221b-4a44-86a8-fa8fd67af927,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converting VIF {"id": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "address": "fa:16:3e:69:93:5c", "network": {"id": "674e75b3-10bc-4d31-a00a-42863500149c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-245592687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ff0991b909c4c009db61cdb6aa56910", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfce296bf-af", "ovs_interfaceid": "fce296bf-afc9-4efd-b839-d19ca3f3b55b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.network.os_vif_util [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af') {{(pid=74441) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG os_vif [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af') {{(pid=74441) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfce296bf-af, bridge=br-int, if_exists=True) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa55b72b-af95-4c2d-a1d4-84d6cdff9605) {{(pid=74441) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:37 user nova-compute[74441]: INFO os_vif [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:93:5c,bridge_name='br-int',has_traffic_filtering=True,id=fce296bf-afc9-4efd-b839-d19ca3f3b55b,network=Network(674e75b3-10bc-4d31-a00a-42863500149c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfce296bf-af')
Nov 09 01:24:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Deleting instance files /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927_del
Nov 09 01:24:37 user nova-compute[74441]: INFO nova.virt.libvirt.driver [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Deletion of /opt/stack/data/nova/instances/b7aa8e3a-221b-4a44-86a8-fa8fd67af927_del complete
Nov 09 01:24:37 user nova-compute[74441]: INFO nova.compute.manager [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 01:24:37 user nova-compute[74441]: DEBUG oslo.service.loopingcall [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74441) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.compute.manager [-] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Deallocating network for instance {{(pid=74441) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 01:24:37 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] deallocate_for_instance() {{(pid=74441) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 01:24:38 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:38 user nova-compute[74441]: DEBUG nova.network.neutron [-] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Updating instance_info_cache with network_info: [] {{(pid=74441) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 01:24:39 user nova-compute[74441]: INFO nova.compute.manager [-] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Took 1.09 seconds to deallocate network for instance.
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-8ed15aff-bd93-4ebe-bf83-eba14fbc2d8c req-88f69b64-fd0c-407d-9c22-0caecb6e6aca service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-vif-deleted-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74441) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:39 user nova-compute[74441]: INFO nova.scheduler.client.report [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Deleted allocations for instance b7aa8e3a-221b-4a44-86a8-fa8fd67af927
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-23b501e9-8e6f-471b-a009-f8d6100123a0 tempest-VolumesActionsTest-79567891 tempest-VolumesActionsTest-79567891-project-member] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.244s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f950c0-53bc-4ce7-b7e3-63910bf15fc5 req-461328b3-4c3b-44e7-9cdd-a5653fabe340 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received event network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f950c0-53bc-4ce7-b7e3-63910bf15fc5 req-461328b3-4c3b-44e7-9cdd-a5653fabe340 service nova] Acquiring lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f950c0-53bc-4ce7-b7e3-63910bf15fc5 req-461328b3-4c3b-44e7-9cdd-a5653fabe340 service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [req-d6f950c0-53bc-4ce7-b7e3-63910bf15fc5 req-461328b3-4c3b-44e7-9cdd-a5653fabe340 service nova] Lock "b7aa8e3a-221b-4a44-86a8-fa8fd67af927-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:24:39 user nova-compute[74441]: DEBUG nova.compute.manager [req-d6f950c0-53bc-4ce7-b7e3-63910bf15fc5 req-461328b3-4c3b-44e7-9cdd-a5653fabe340 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] No waiting events found dispatching network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b {{(pid=74441) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 01:24:39 user nova-compute[74441]: WARNING nova.compute.manager [req-d6f950c0-53bc-4ce7-b7e3-63910bf15fc5 req-461328b3-4c3b-44e7-9cdd-a5653fabe340 service nova] [instance: b7aa8e3a-221b-4a44-86a8-fa8fd67af927] Received unexpected event network-vif-plugged-fce296bf-afc9-4efd-b839-d19ca3f3b55b for instance with vm_state deleted and task_state None.
Nov 09 01:24:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:44 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:24:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:24:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:24:58 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:25:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:14 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:25:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:25:14 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:25:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:22 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:26 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:26 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:25:27 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:25:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:25:28 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=9067MB free_disk=24.941375732421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing inventories for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating ProviderTree inventory for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Updating inventory in ProviderTree for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing aggregate associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, aggregates: None {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 01:25:28 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Refreshing trait associations for resource provider 72c49dde-a35c-4022-97fb-5b646dea5c73, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO {{(pid=74441) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 01:25:29 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:25:29 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:25:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:25:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:25:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:33 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:33 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:36 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:25:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:25:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:25:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:25:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:25:39 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:25:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:25:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:25:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:25:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:26:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:26:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:26:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:26:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:26:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:26 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:28 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:28 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:26:28 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:26:29 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:26:29 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=24.939491271972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:26:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:26:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:26:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74441) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 01:26:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:26:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74441) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 01:26:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:38 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:40 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:45 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:26:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:26:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:27:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:13 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:27:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:27:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:27:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:24 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:27:29 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:27:29 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=24.937679290771484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:27:29 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:27:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:30 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:27:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:36 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:27:39 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:41 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:27:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:27:47 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:27:52 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:27:57 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:02 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:07 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:12 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:15 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Starting heal instance info cache {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:28:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Rebuilding the list of instances to heal {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:28:15 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Didn't find any instances for network info cache update. {{(pid=74441) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:28:17 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:28:22 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:23 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:25 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:27 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Auditing locally available compute resources for user (node: user) {{(pid=74441) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:28:30 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:28:30 user nova-compute[74441]: WARNING nova.virt.libvirt.driver [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Hypervisor/Node resource view: name=user free_ram=9260MB free_disk=24.926040649414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=74441) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74441) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.compute.provider_tree [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed in ProviderTree for provider: 72c49dde-a35c-4022-97fb-5b646dea5c73 {{(pid=74441) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.scheduler.client.report [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Inventory has not changed for provider 72c49dde-a35c-4022-97fb-5b646dea5c73 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74441) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG nova.compute.resource_tracker [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Compute_service record updated for user:user {{(pid=74441) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:28:30 user nova-compute[74441]: DEBUG oslo_concurrency.lockutils [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=74441) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:28:31 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:32 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:32 user nova-compute[74441]: DEBUG nova.compute.manager [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74441) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:28:32 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 01:28:34 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:36 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:37 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:40 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:42 user nova-compute[74441]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74441) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 01:28:43 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:28:47 user nova-compute[74441]: DEBUG oslo_service.periodic_task [None req-96f4bf17-8fb8-4f08-863c-f8ea06b45242 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74441) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}